-- Logs begin at Wed 2022-07-20 21:44:52 UTC, end at Wed 2022-07-20 23:19:48 UTC. -- Jul 20 22:36:06.533105 dv-cinder-799871-38-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 22:36:06.542527 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 22:36:06 2022] *** Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: nodename: dv-cinder-799871-38-iscsi Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: machine: x86_64 Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: clock source: unix Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: pcre jit disabled Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: detected number of CPU cores: 4 Jul 20 22:36:06.544570 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: current working directory: / Jul 20 22:36:06.545193 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: detected binary path: /usr/bin/uwsgi-core Jul 20 22:36:06.545193 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: your processes number limit is 47680 Jul 20 22:36:06.545193 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: your memory page size is 4096 bytes Jul 20 22:36:06.545193 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: detected max file descriptor number: 2048 Jul 20 22:36:06.545193 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: lock engine: pthread robust mutexes Jul 20 22:36:06.545193 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: thunder lock: enabled Jul 20 22:36:06.545193 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 22:36:06.545193 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 22:36:06.589500 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: Python main interpreter initialized at 0x564b687d59c0 Jul 20 22:36:06.589500 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: python threads support enabled Jul 20 22:36:06.589500 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: your server socket listen backlog is limited to 100 connections Jul 20 22:36:06.589500 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: your mercy for graceful operations on workers is 90 seconds Jul 20 22:36:06.589819 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 22:36:06.589893 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: *** Operational MODE: preforking *** Jul 20 22:36:06.590153 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: *** uWSGI is running in multiple interpreter mode *** Jul 20 22:36:06.590153 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: spawned uWSGI master process (pid: 110371) Jul 20 22:36:06.590336 dv-cinder-799871-38-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 22:36:06.590976 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: spawned uWSGI worker 1 (pid: 110372, cores: 1) Jul 20 22:36:06.595034 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: spawned uWSGI worker 2 (pid: 110373, cores: 1) Jul 20 22:36:06.595034 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 22:36:07.250307 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 22:36:07.253494 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 22:36:08.375593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:36:08.375593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: from cryptography.utils import int_from_bytes Jul 20 22:36:08.376179 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:36:08.376179 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: from cryptography.utils import int_from_bytes Jul 20 22:36:08.376326 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:36:08.376326 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: from cryptography.utils import int_from_bytes Jul 20 22:36:08.376326 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:36:08.376326 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: from cryptography.utils import int_from_bytes Jul 20 22:36:10.860499 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 22:36:10.861134 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 22:36:10.861501 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 22:36:10.861598 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 22:36:10.861698 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 22:36:10.861786 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 22:36:10.861872 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 22:36:10.861963 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 22:36:10.862055 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 22:36:10.862141 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 22:36:10.862295 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.862400 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.862582 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.862687 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.862908 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.863004 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.863263 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.863410 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.863596 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.863707 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.863913 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.864015 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.864233 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.864333 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.864553 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.864644 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.864885 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.864985 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.865145 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.865243 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.865461 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.865546 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.865787 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-38-iscsi {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.865894 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-38-iscsi {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.866113 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.866218 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.866424 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.866513 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.866734 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.866826 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.867077 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.867184 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.867388 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.867479 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.867713 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.867807 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.868020 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.868119 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.868524 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.868631 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.868984 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.869094 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.869296 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.869388 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.869819 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.869961 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.870069 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.870234 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.870371 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.870460 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.870577 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.870672 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.870902 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.871075 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.871241 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.871368 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.871571 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.871668 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.871881 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.871976 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.872281 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-38-iscsi {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.872393 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-38-iscsi {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.872602 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.872696 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.872921 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.873013 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.873237 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.873341 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.873652 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.873761 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.873965 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.874052 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.874278 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.874371 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.874598 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.874693 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.874924 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.875047 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.875258 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.875344 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.875587 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.875683 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.875914 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.876021 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.876234 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.876326 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.876557 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.876650 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.876861 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.876944 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.877172 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.877264 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.877483 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.877582 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.877803 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.877890 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.878111 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.878196 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.878416 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.878510 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.878668 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.878763 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.878974 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.879098 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.879323 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.879432 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.879648 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.879741 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.879973 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.880062 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.880228 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.880323 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.880478 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.880570 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.880798 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.880913 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.881122 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.881211 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.881431 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.881516 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.881741 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.881840 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.882051 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.882136 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.882357 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.882442 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.882666 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.882758 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.882973 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.883100 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.883306 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.883391 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.883616 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.883713 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.883936 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.884022 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.884254 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.884343 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.884576 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.884662 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.884888 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.885022 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.885231 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.885336 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.885633 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.885726 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.885886 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.885978 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.886198 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.886290 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.886540 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.886626 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.886860 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.886965 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.887197 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.887293 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.887520 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.887625 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.887842 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.887935 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.888153 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.888255 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.888461 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.888558 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.888770 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.888855 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.889092 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.889184 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.889418 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.889504 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.889725 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.889808 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.889977 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.890074 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.890281 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.890376 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.890590 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.890675 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.890912 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.891038 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.891253 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.891356 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.891561 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.891647 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.891871 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.891956 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.892171 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.892269 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.892481 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.892573 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.892788 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.892890 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.893125 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.893223 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.893406 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.893496 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.893714 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.893801 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.894020 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.894107 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.894326 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.894415 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.894633 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.894718 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.894938 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.895063 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.895283 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.895380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.895606 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.895701 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.895916 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.896001 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.896226 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.896391 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.896531 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.896616 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.896838 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.896932 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.897159 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.897251 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.897469 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.897561 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.897775 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.897858 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.898099 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.898184 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.898407 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.898493 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.898711 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.898794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.899045 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.899147 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.899361 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.899450 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.899671 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.899763 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.899991 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.900084 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.900296 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.900393 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.900602 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.900694 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.901436 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.901536 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.901754 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.901840 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.902063 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.902148 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.902371 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.902468 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.902676 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.902759 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.902982 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.903097 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.903315 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.903406 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.903620 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.903709 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.903927 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.904026 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.904231 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.904368 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.904550 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.904645 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.904873 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.904965 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.905184 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.905307 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.905491 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.905583 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.905798 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.905891 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.906119 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.906208 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:36:10.906454 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.906546 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.906787 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.906895 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.907157 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.907256 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.907476 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.907571 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.907811 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.907906 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.908145 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.908237 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.908466 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.908600 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.908779 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.908875 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.909096 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.909187 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.909422 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.909513 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.909736 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.909821 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.910045 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.910136 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.910358 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.910453 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.910676 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.910770 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.910997 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.911122 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.911350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.911436 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.911670 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.911766 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.911985 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.912072 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.912305 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.912397 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.912617 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.912715 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.912936 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.913020 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.913264 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.913353 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.913587 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.913673 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.913899 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.913993 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.914240 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.914326 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.914587 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.914672 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.914902 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.914997 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.915253 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.915361 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.915580 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.915675 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.915893 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.915984 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.916205 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.916302 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.916571 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.917490 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.917669 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.917757 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.918012 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.918107 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.918437 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.918569 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.918682 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.918787 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.918950 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.919143 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.919312 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.919405 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.919630 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.919731 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.919945 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.920031 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.920258 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.920344 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.920597 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.920690 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.920916 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.921002 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.921231 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.921327 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.921546 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.921638 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.921873 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.921966 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.922186 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.922271 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.922499 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.922583 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.922881 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.922976 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.923142 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.923230 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.923452 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.923551 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.923760 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.923847 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.924072 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.924157 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.924378 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.924470 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.924699 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.924791 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.925027 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.925113 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.925338 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.925431 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.925685 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.925805 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.925979 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.926065 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.926292 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.926391 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.926604 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.926689 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.926914 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.926999 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.927245 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.927342 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.927560 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.927675 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.927873 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.927965 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.928178 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.928265 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.928504 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.928588 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.928819 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.928903 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.929126 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.929220 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.929453 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.929538 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.929762 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.929857 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.930068 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.930154 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.930384 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.930467 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.930697 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.930784 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.931022 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.931110 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.931346 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.931432 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.931663 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.931759 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.931988 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.932108 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.932331 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.932424 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.932646 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.932744 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.932982 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.933067 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.933317 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.933409 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.933624 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.933716 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.933951 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.934037 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.934279 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.934362 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.934598 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.934694 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.934905 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.934990 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.935242 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.935338 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.935548 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.935678 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.935857 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.935942 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.936164 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.936248 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.936477 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.936563 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.936783 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.936869 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.937091 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.937184 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.937397 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.937494 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.937704 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.937788 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.938009 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.938094 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.938333 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.938418 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.938643 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.938726 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.938947 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.939061 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.939285 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.939378 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.939591 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.939683 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.939938 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.940041 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.940247 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.940333 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.940588 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.940672 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.940926 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.941034 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.941249 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.941341 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.941575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.941661 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.941895 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.941987 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.942214 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.942300 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.942526 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.942610 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.942842 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.942934 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.943180 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.943267 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.943495 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.943580 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.943817 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.943910 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.944132 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.944256 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.944455 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.944553 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.944768 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.944854 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.945092 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.945180 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.945407 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.945493 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.945728 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.945813 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.946035 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.946119 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.946354 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.946437 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.946692 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.946778 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.947047 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.947170 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.947372 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.947488 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.947717 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.947814 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.948033 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.948131 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.948352 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.948531 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.948667 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.948763 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.948980 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.949064 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.949294 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.949392 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.949609 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.949693 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.949929 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.950018 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.950242 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.950334 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.950561 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.950655 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.950874 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.950958 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.951224 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.951321 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.951540 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.951626 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.951864 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.951957 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.952173 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.952260 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.952491 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.952576 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.952822 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.952913 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.953156 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.953255 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.953470 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.953553 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.953787 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.953883 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.954108 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.954194 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.954420 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.954527 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.954732 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.954826 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.955064 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.955164 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.955378 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.955530 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.955685 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.955788 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.956000 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.956085 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.956315 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.956398 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.956627 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.956724 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.956941 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.957026 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.957248 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.957332 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.957566 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.957662 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.957875 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.957959 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.958181 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.958274 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.958486 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.958571 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.958797 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.958882 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.959145 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.959233 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.959464 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.959552 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.959787 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.959870 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.960112 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.960197 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.960420 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.960512 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.960725 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.960810 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.961047 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.961138 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.961360 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.961455 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.961669 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.961754 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.961975 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.962066 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.962281 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.962375 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.962625 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.962717 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.962937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.963052 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.963269 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.963856 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.964119 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.964239 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.964447 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.964608 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.964745 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.964879 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.965068 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.965222 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.965363 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.965516 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.965668 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.965807 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.965997 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.966225 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.966372 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.966618 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.966784 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.966930 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.967272 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.967361 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.967589 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.967911 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.968071 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.968233 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.968323 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.968548 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.968864 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.968950 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.969184 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.969440 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.969528 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.969792 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.970015 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.970104 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.970606 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.970750 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.970957 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.971165 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.971349 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.971489 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.971674 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.971819 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.972002 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.972195 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.972324 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.972545 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.972666 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.973002 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.973346 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.973445 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.973659 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.973778 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.973982 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.974113 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.974292 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.974449 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.974584 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.974784 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.974905 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.975141 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.975244 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.975490 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.975585 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.975830 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.975958 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.976144 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.976232 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.976453 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.976554 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.976761 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.976849 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.977070 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.977156 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.977379 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.977466 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.977697 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.977791 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.978007 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.978092 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.978319 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.978402 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.978627 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.978713 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.978981 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.979674 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.979850 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.979957 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.980161 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.980246 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.980471 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.980555 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.980780 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.980872 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.981105 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.981198 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.981417 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.981510 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.981740 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.981833 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.982053 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.982153 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.982378 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.982473 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.982694 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.982796 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.983035 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.983134 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.983339 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.983432 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.983651 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.983784 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.983972 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.984096 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.984277 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.984363 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.984591 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.984734 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.984904 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.984992 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.985212 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.985339 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.985528 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.985653 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.985841 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.985964 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.986158 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.986293 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.986471 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.986604 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.986779 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.986912 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.987116 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.987249 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.987427 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.987562 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.987746 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.987876 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.988055 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.988183 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.988363 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.988499 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.988669 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.988812 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.988982 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.989125 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.989294 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.989437 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.989599 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.989743 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.989910 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.990055 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.990216 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.990364 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.990537 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.990682 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.990846 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.991108 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.991252 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.991443 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.991562 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.991758 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.991874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.992071 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.992188 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.992384 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.992495 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.992691 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.992824 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.993003 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.993142 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.993309 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.993452 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.993631 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.993762 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.993939 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.994082 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.994248 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.994391 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.994573 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.994724 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.994890 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.995063 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.995233 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.995395 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.995543 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.995719 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.995870 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.996029 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.996186 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.996346 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.996493 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.996657 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.996802 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.996968 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.997114 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.997279 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.997422 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.997594 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.997731 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.997902 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.998045 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.998210 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.998371 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.998517 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.998692 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.998825 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.998998 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.999160 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.999330 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.999487 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.999637 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.999804 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:10.999946 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.000114 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.000252 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.000426 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.000549 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.000735 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.000855 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.001083 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.001170 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.001392 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.001477 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.001751 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.001843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.002057 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.002146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.002373 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.002458 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.002683 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.002777 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.002989 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.003152 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.003322 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.003408 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.003631 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.003730 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.003948 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.004033 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.004268 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.004354 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.004585 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.004754 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.004904 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.004990 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.005213 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.005307 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.005521 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.005616 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.005840 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.005925 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.006154 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.006247 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.006469 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.006564 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.006777 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.006862 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.007121 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.007211 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.007439 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.007526 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.007745 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.007841 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.008050 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.008146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.008357 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.008444 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.008666 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.008759 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.008980 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.009065 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.009291 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.009377 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.009602 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.009690 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.009917 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.010021 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.010254 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.010344 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.010561 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.010695 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.010873 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.010971 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.011210 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.011298 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.011523 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.011621 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.011835 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.011930 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.012144 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.012230 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.012455 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.012546 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.012769 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.012868 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.013074 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.013159 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.013385 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.013469 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.013693 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.013779 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.013998 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.014082 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.014309 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.014395 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.014619 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.014741 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.014927 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.015082 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.015278 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.015388 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.015592 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.015687 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.015900 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.015985 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.016212 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.016311 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.016521 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.016615 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.016837 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.016922 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.017147 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.017241 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.017577 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.017663 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.017893 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.017977 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.018208 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.018296 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.018520 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.018623 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.018830 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.018916 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.019168 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.019271 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.019485 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.019571 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.019802 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.019894 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.020111 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.020210 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.020418 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.020532 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.020726 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.020850 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.021052 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.021165 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.021359 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.021479 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.021682 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.021795 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.022103 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.022189 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.022414 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.022500 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.022722 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.022859 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.023059 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.023168 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.023370 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.023485 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.023677 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.023809 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.024003 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.024115 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.024309 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.024439 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.024632 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.024766 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.025052 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.025140 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.025370 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.025456 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.025679 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.025771 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.026567 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.026668 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.026900 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.026991 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.027257 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.027357 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.027577 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.027672 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.027886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.027973 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.028213 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.028300 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.028526 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.028620 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.028841 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.028926 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.029151 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.029244 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.029477 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.029572 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.029808 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.029894 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.030124 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.030216 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.030443 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.030530 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.030749 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.030871 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.031102 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.031195 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.031429 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.031518 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.031742 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.031827 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.032052 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.032147 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.032363 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.032477 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.032693 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.032803 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.033005 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.033102 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.033320 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.033430 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.033634 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.033759 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.033947 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.034070 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.034256 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.034378 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.034568 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.034693 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.034897 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.034996 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.035233 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.035310 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.035560 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.035648 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.035880 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.035974 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.036208 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.036295 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.036528 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.036612 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.036835 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.036922 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.037140 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.037225 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.037448 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.037534 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.037760 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.037847 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.038067 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.038158 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.038375 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.038466 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.038698 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.038800 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.039045 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.039144 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.039358 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.039444 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.039670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.039757 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.039995 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.040088 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.040307 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.040401 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.040613 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.040702 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.040923 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.041017 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.041230 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.041325 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.042401 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.042496 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.042719 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.042804 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.043052 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.043154 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.043369 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.043454 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.043685 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.043770 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.043995 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.044090 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.044309 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.044395 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.044626 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.044719 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.044940 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.045029 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.045250 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.045335 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.045559 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.045644 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.045865 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.045961 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.046172 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.046258 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.046485 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.046578 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.046794 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.046880 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.047129 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.047218 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.047441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.047526 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.047753 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.047841 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.048058 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.048142 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.048364 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.048459 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.048670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.048755 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.048995 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.049089 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.049302 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.049400 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.049625 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.049711 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.049938 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.050031 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.050249 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.050384 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.050563 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.050663 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.050866 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.050952 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.051227 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.051328 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.051532 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.051618 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.051857 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.051943 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.052176 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.052262 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.052492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.052577 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.052813 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.052899 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.053124 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.053218 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.053443 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.053529 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.053761 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.053846 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.054080 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.054167 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.054400 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.054605 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.054718 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.054943 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.055070 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.055297 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.055383 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.055620 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.055710 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.055940 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.056035 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.056260 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.056346 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.056575 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.056668 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.056891 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.056978 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.057275 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.057535 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.057621 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.057871 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.057975 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.058190 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.058277 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.058509 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.058602 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.058825 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.058925 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.059166 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.059254 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.059485 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.059570 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.059802 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.059897 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.060116 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.060202 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.060430 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.060516 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.060743 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.060831 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.061076 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.061163 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.061397 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.061559 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.061721 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.061808 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.062043 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.062129 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.062363 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.062457 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.062681 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.062767 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.062995 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.063111 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.063337 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.063435 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.063656 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.063748 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.063972 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.064058 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.064287 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.064375 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.064604 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.064689 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.064921 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.065007 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.065235 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.065336 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.065573 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.065660 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.065886 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.065984 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.066205 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.066300 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.066522 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.066608 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.066835 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.066935 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.067171 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.067379 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.067490 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.067699 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.067792 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.068037 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.068126 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.068371 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.068456 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.068702 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.068795 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.069025 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.069111 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.069347 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.069449 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.069663 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.069761 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.069975 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.070188 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.070274 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.070509 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.070596 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.070846 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.070941 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.071202 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.071289 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.071530 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.071614 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.071848 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.071999 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.072156 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.072242 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.072481 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.072576 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.072815 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.072903 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.073124 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.073351 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.073439 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.073705 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.073793 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.074028 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.074113 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.074351 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.074435 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.074666 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.074754 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.074974 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.075095 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.075319 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.075405 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.075629 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.075718 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.075948 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.076164 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.076253 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.076516 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.076605 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.076835 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.076928 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.077155 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.077242 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.077464 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.077552 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.077781 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.077868 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.078086 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.078171 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.078392 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.078479 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.078707 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.078801 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.079030 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.079119 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.079354 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.079448 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.079666 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.079753 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.079971 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.080064 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.080277 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.080370 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.080590 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.080683 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.080901 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.080995 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.081205 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.081297 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.081511 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.081605 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.081816 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.081915 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.082126 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.082212 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.082434 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.082521 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.082742 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.082836 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.083067 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.083157 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.083386 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.083474 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.083692 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.083778 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.084000 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.084086 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.084307 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.084392 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.084612 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.084701 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.084925 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.085012 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.085231 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.085317 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.085542 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.085629 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.085848 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.085934 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.086161 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.086247 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.086469 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.086556 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.086777 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.086863 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.087147 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.087293 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.087471 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.087558 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.087780 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.088008 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.088104 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.088885 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.088982 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.089217 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.089305 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.089538 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.089623 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.089853 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.089985 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.090168 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.090255 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.090482 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.090567 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.090795 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.090882 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.091158 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.091367 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.091479 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.091703 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.091792 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.092025 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.092113 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.092359 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.092453 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.092692 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.092779 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.093006 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.093092 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.093314 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.093407 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.093621 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.093709 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.093934 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.094019 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.094249 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.094347 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.094561 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.094650 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.094872 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.094959 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.095212 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.095310 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.095528 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.095614 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.095840 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.095926 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.096153 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.096251 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.096464 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.096551 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.096776 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.096863 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.097087 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.097184 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.097400 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.097488 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.097711 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.097797 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.098022 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.098117 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.098335 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.098422 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.098657 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.098743 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.098985 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.099129 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.099328 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.099415 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.099641 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.099727 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.099959 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.100068 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.100275 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.100390 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.100590 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.100716 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.100903 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.101041 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.101214 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.101357 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.101531 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.101683 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.101862 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.102009 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.102179 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.102325 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.102487 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.102651 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.102915 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.103000 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.103259 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.103354 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.103583 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.103671 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.103923 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.104593 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.104781 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.104869 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.105107 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.105195 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.105434 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.105528 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.105742 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.105829 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.106057 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.106154 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.106369 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.106455 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.106678 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.106773 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.106987 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.107151 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.107318 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.107441 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.107631 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.107728 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.107938 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.108025 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.108248 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.108334 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.108556 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.108650 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.108864 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.108951 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.109177 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.109263 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.109485 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.109616 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.109791 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.109876 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.110095 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.110181 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.110402 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.110490 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.110753 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.110845 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.111088 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.111179 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.111342 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.111429 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.111646 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.111776 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.111954 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.112041 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.112256 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.112342 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.112561 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.112645 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.112866 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.112952 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.113169 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.113269 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.113476 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.113563 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.113779 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.113874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.114090 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.114176 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.114395 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.114481 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.114702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.114801 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.115019 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.115108 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.115340 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.115426 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.115645 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.115743 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.115977 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.116064 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.116310 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.116397 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.116626 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.116720 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.116946 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.117032 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.117258 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.117351 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.117571 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.117658 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.117878 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.117963 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.118188 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.118273 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.118503 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.118590 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.118820 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.118911 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.119159 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.119251 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.119481 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.119587 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.119821 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.119907 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.120134 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.120233 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.120448 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.120535 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.120761 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.120848 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.121073 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.121166 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.121384 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.121478 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.121713 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.121799 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.122030 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.122130 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.122337 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.122424 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.122651 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.122744 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.122964 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.123066 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.123310 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.123398 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.123626 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.123710 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.123938 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.124026 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.124257 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.124349 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.124569 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.124661 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.124884 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.124979 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.125197 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.125283 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.125510 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.125609 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.125824 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.125911 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.126141 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.126234 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.126455 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.126567 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.126769 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.126866 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.127121 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.127211 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.127444 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.127544 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.127774 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.127860 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.128090 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.128183 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.128400 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.128494 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.128645 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110373) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 22:36:11.128731 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.129308 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.129407 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.129697 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.130046 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.130379 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.130700 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.131043 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.131348 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:36:11.131594 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110372) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 22:36:11.190868 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO dbcounter [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Registered counter for database nova_api Jul 20 22:36:11.193459 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO dbcounter [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Registered counter for database nova_api Jul 20 22:36:11.303930 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_db.sqlalchemy.engines [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:36:11.308071 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG oslo_db.sqlalchemy.engines [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:36:11.310847 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writer thread running {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:36:11.314453 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writer thread running {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:36:11.367721 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.context [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac8e65b0-7529-4d82-95f8-8407fdc93621(cell1) {{(pid=110373) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 22:36:11.370602 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.context [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac8e65b0-7529-4d82-95f8-8407fdc93621(cell1) {{(pid=110372) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 22:36:11.371797 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:36:11.373396 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:36:11.374205 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:36:11.374552 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG oslo_concurrency.lockutils [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:36:11.376178 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG oslo_concurrency.lockutils [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:36:11.376368 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:36:11.376982 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG oslo_concurrency.lockutils [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:36:11.378349 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO dbcounter [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Registered counter for database nova_cell0 Jul 20 22:36:11.379140 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG oslo_concurrency.lockutils [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110372) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:36:11.381107 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO dbcounter [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Registered counter for database nova_cell0 Jul 20 22:36:11.382258 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO dbcounter [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Registered counter for database nova_cell1 Jul 20 22:36:11.384893 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO dbcounter [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Registered counter for database nova_cell1 Jul 20 22:36:11.390504 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_db.sqlalchemy.engines [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:36:11.392226 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_db.sqlalchemy.engines [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:36:11.393864 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG oslo_db.sqlalchemy.engines [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:36:11.395566 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG oslo_db.sqlalchemy.engines [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:36:11.398181 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writer thread running {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:36:11.400292 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writer thread running {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:36:11.401985 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writer thread running {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:36:11.404075 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writer thread running {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:36:11.546800 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO dbcounter [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Registered counter for database nova_cell0 Jul 20 22:36:11.548889 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO dbcounter [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Registered counter for database nova_cell0 Jul 20 22:36:11.553417 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_db.sqlalchemy.engines [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110373) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:36:11.555545 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG oslo_db.sqlalchemy.engines [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110372) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:36:11.558436 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writer thread running {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:36:11.562633 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writer thread running {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:36:12.003902 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: WARNING keystonemiddleware.auth_token [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 22:36:12.011268 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: WARNING keystonemiddleware.auth_token [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 22:36:12.022249 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: WARNING keystonemiddleware.auth_token [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 22:36:12.029781 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: WARNING keystonemiddleware.auth_token [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 22:36:12.349168 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: WARNING keystonemiddleware.auth_token [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 22:36:12.355829 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: WARNING keystonemiddleware.auth_token [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 22:36:12.361179 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b687d59c0 pid: 110373 (default app) Jul 20 22:36:12.363272 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:36:12.364478 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001765 Jul 20 22:36:12.364886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 788 bytes} [Wed Jul 20 22:36:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:36:12.372221 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: WARNING keystonemiddleware.auth_token [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 22:36:12.378456 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: WARNING keystonemiddleware.auth_token [None req-c8c4cc1d-2338-4359-b786-c268824ba266 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 22:36:12.383839 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b687d59c0 pid: 110372 (default app) Jul 20 22:37:31.576420 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:31.577438 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 20 22:37:31.577819 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 2/2] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:31.594544 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_api:SELECT=3 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:37:31.597053 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_cell0:SELECT=3 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:37:31.597970 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_cell1:SELECT=3 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:37:31.598856 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:37:32.507702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-740220ed-321d-4fa0-a109-2234cfab35d4 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:32.537613 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-740220ed-321d-4fa0-a109-2234cfab35d4 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.952641 Jul 20 22:37:32.551401 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 1/3] 10.222.0.81 () {60 vars in 1291 bytes} [Wed Jul 20 22:37:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:37:34.765252 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:34.766259 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-582f685c-4732-43b7-9851-33f0ff578ce4 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 20 22:37:34.766821 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 3/4] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:35.259213 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1f26dcb4-8388-42b1-aa65-5371408d84a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:35.278197 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:37:35.278197 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: warnings.warn(msg) Jul 20 22:37:35.383041 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-1f26dcb4-8388-42b1-aa65-5371408d84a9 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.610233 Jul 20 22:37:35.384049 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 2/5] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:37:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:37:35.397306 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=3 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:37:35.398167 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell0:SELECT=3 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:37:35.399139 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell1:SELECT=3 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:37:35.399980 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:37:35.603588 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-daf1714a-0235-40ee-b79b-fffbd2efce7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:35.606257 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:37:35.606257 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 20 22:37:35.713084 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-daf1714a-0235-40ee-b79b-fffbd2efce7f admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321147 Jul 20 22:37:35.713676 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 4/6] 10.222.0.81 () {64 vars in 1335 bytes} [Wed Jul 20 22:37:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:37:37.995633 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1f26dcb4-8388-42b1-aa65-5371408d84a9 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:37.996710 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-1f26dcb4-8388-42b1-aa65-5371408d84a9 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 20 22:37:37.997286 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 3/7] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:38.672229 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-f470f76e-897b-4acf-b553-b9c96847e641 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:38.690210 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:37:38.690210 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 20 22:37:38.784846 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-f470f76e-897b-4acf-b553-b9c96847e641 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.781319 Jul 20 22:37:38.785665 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 5/8] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:37:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:37:38.798121 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-3bdb6b3f-5175-4944-9624-d45a6d7c185e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:38.799630 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:37:38.799630 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: warnings.warn(msg) Jul 20 22:37:38.890065 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-3bdb6b3f-5175-4944-9624-d45a6d7c185e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095595 Jul 20 22:37:38.890949 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 4/9] 10.222.0.81 () {64 vars in 1335 bytes} [Wed Jul 20 22:37:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:37:41.222278 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-f470f76e-897b-4acf-b553-b9c96847e641 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:41.223855 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-f470f76e-897b-4acf-b553-b9c96847e641 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 22:37:41.224253 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 6/10] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:41.610232 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1d259caf-81a1-4395-ae1f-96e0036948c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:41.679780 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-1d259caf-81a1-4395-ae1f-96e0036948c4 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449577 Jul 20 22:37:41.680250 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 5/11] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:37:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:37:41.692325 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-78980925-6250-4745-897b-7fc1adbe6e9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:41.819984 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-78980925-6250-4745-897b-7fc1adbe6e9e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131260 Jul 20 22:37:41.835185 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 7/12] 10.222.0.81 () {64 vars in 1335 bytes} [Wed Jul 20 22:37:41 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:37:44.036741 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1d259caf-81a1-4395-ae1f-96e0036948c4 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:44.038048 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-1d259caf-81a1-4395-ae1f-96e0036948c4 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001720 Jul 20 22:37:44.038450 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 6/13] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:44.529506 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-ec42ce67-889c-41f5-b7ea-b12a2959405f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "vcpus": 2, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:44.674827 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-ec42ce67-889c-41f5-b7ea-b12a2959405f admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.630280 Jul 20 22:37:44.675531 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 8/14] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:37:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:37:44.687420 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-71f1e2a1-eb00-4d7b-a533-1d18a66668e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:44.832997 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-71f1e2a1-eb00-4d7b-a533-1d18a66668e1 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148694 Jul 20 22:37:44.833695 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 7/15] 10.222.0.81 () {64 vars in 1335 bytes} [Wed Jul 20 22:37:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:37:47.107001 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-ec42ce67-889c-41f5-b7ea-b12a2959405f admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:47.108120 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-ec42ce67-889c-41f5-b7ea-b12a2959405f admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001612 Jul 20 22:37:47.108805 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 9/16] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:47.537334 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-835bed9e-5593-4602-96a1-2ad90f11e111 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "name": "ds4G", "swap": 0}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:47.606737 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-835bed9e-5593-4602-96a1-2ad90f11e111 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490866 Jul 20 22:37:47.607802 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 8/17] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:37:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:37:47.621744 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-96b83a3d-4706-4140-91ab-2a52006b68ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:47.676862 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-96b83a3d-4706-4140-91ab-2a52006b68ca admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058874 Jul 20 22:37:47.677427 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 10/18] 10.222.0.81 () {64 vars in 1335 bytes} [Wed Jul 20 22:37:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:37:50.058516 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-835bed9e-5593-4602-96a1-2ad90f11e111 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:50.059606 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-835bed9e-5593-4602-96a1-2ad90f11e111 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 20 22:37:50.060010 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 9/19] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:50.517851 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-a725ced7-f431-4875-9b2e-2d1f49383006 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:50.542969 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-a725ced7-f431-4875-9b2e-2d1f49383006 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.476886 Jul 20 22:37:50.543504 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 11/20] 10.222.0.81 () {60 vars in 1291 bytes} [Wed Jul 20 22:37:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:37:52.858035 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-835bed9e-5593-4602-96a1-2ad90f11e111 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:52.859586 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-835bed9e-5593-4602-96a1-2ad90f11e111 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002044 Jul 20 22:37:52.860246 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 10/21] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:53.299707 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-526ca129-cae9-47e3-be69-8356c5970daa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "swap": 0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:53.382322 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-526ca129-cae9-47e3-be69-8356c5970daa admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.516020 Jul 20 22:37:53.382870 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 12/22] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:37:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 22:37:53.396591 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-8957c633-3c5a-44e6-8f66-b3ff2cfda042 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:53.483931 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-8957c633-3c5a-44e6-8f66-b3ff2cfda042 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092308 Jul 20 22:37:53.484639 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 11/23] 10.222.0.81 () {64 vars in 1332 bytes} [Wed Jul 20 22:37:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:37:55.743297 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-526ca129-cae9-47e3-be69-8356c5970daa admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:55.744354 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-526ca129-cae9-47e3-be69-8356c5970daa admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jul 20 22:37:55.744758 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 13/24] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:56.281154 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-d3b4477e-101c-4d37-8739-ea92e27e49a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:56.404970 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-d3b4477e-101c-4d37-8739-ea92e27e49a6 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.654185 Jul 20 22:37:56.409213 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 12/25] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:37:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:37:56.418518 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-b9aa255e-a439-4349-a18e-8dde2362713d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:56.505298 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-b9aa255e-a439-4349-a18e-8dde2362713d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090495 Jul 20 22:37:56.505873 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 14/26] 10.222.0.81 () {64 vars in 1332 bytes} [Wed Jul 20 22:37:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:37:58.785396 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-d3b4477e-101c-4d37-8739-ea92e27e49a6 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:37:58.786678 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-d3b4477e-101c-4d37-8739-ea92e27e49a6 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Jul 20 22:37:58.787095 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 13/27] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:37:59.233722 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-9d558a46-525f-4328-adec-e485b364c2a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:59.301849 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-9d558a46-525f-4328-adec-e485b364c2a6 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.509129 Jul 20 22:37:59.303035 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 15/28] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:37:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:37:59.314811 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-bcc8167a-01cc-4d58-a22d-79d0381a6594 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:37:59.397716 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-bcc8167a-01cc-4d58-a22d-79d0381a6594 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086417 Jul 20 22:37:59.398680 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 14/29] 10.222.0.81 () {64 vars in 1332 bytes} [Wed Jul 20 22:37:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:38:01.670047 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-9d558a46-525f-4328-adec-e485b364c2a6 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:01.671135 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-9d558a46-525f-4328-adec-e485b364c2a6 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 20 22:38:01.671801 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 16/30] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:38:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:38:02.130542 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-69e0ca6b-b5b5-431f-81d3-fac1bf087bba admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:38:02.135987 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:02.524186 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-69e0ca6b-b5b5-431f-81d3-fac1bf087bba admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.845958 Jul 20 22:38:02.524965 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 15/31] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:38:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 22:38:02.537243 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-1a463771-1ccf-4958-b922-50636f0fc30e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:38:02.643138 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-1a463771-1ccf-4958-b922-50636f0fc30e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109911 Jul 20 22:38:02.643852 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 17/32] 10.222.0.81 () {64 vars in 1332 bytes} [Wed Jul 20 22:38:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:38:04.931225 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-69e0ca6b-b5b5-431f-81d3-fac1bf087bba admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:04.932886 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-69e0ca6b-b5b5-431f-81d3-fac1bf087bba admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Jul 20 22:38:04.933459 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 16/33] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:05.383673 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-89d53ccd-b2ef-4da8-91a8-78e64ef6438c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:38:05.450836 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-89d53ccd-b2ef-4da8-91a8-78e64ef6438c admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.511501 Jul 20 22:38:05.459445 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 18/34] 10.222.0.81 () {64 vars in 1282 bytes} [Wed Jul 20 22:38:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:38:05.464243 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-5b1bb5a5-9f60-4f51-86b4-9d8b14d9e0a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:38:05.570847 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-5b1bb5a5-9f60-4f51-86b4-9d8b14d9e0a7 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110193 Jul 20 22:38:05.571869 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 17/35] 10.222.0.81 () {64 vars in 1332 bytes} [Wed Jul 20 22:38:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:38:25.460304 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-89d53ccd-b2ef-4da8-91a8-78e64ef6438c admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:25.461283 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-89d53ccd-b2ef-4da8-91a8-78e64ef6438c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 20 22:38:25.461676 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 19/36] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:38:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:25.844059 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-a6a63604-1d39-4fdf-b1d7-f96161a1580f admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:25.860711 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-a6a63604-1d39-4fdf-b1d7-f96161a1580f admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393292 Jul 20 22:38:25.861231 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 18/37] 10.222.0.81 () {60 vars in 1291 bytes} [Wed Jul 20 22:38:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:38:26.956767 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-89d53ccd-b2ef-4da8-91a8-78e64ef6438c admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:26.957796 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-89d53ccd-b2ef-4da8-91a8-78e64ef6438c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 20 22:38:26.958190 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 20/38] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:27.475888 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1301d461-e31a-47d9-b86e-7ddf8044e4f4 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:27.481649 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.wsgi [None req-1301d461-e31a-47d9-b86e-7ddf8044e4f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1301d461-e31a-47d9-b86e-7ddf8044e4f4 admin admin] Request method failure captured: Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Accept: application/json Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Accept-Encoding: gzip, deflate Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Connection: keep-alive Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Content-Length: 0 Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Host: 10.222.0.81 Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Openstack-Api-Version: compute 2.90 Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Openstack-System-Scope: None Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: User-Agent: python-novaclient Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Auth-Token: gAAAAABi2IPitWLkkomBdz4NFsq_4RKKPRgpq1lmKf48cCaCSM5GuTV--ACW-65Ddkla-WmRcfD5j2vrRLib2Gk_DD8UhmnCMgposoJQxHplIyyWrZlgH8na0PmNwGmlnYnUL8bgeBlYx8kGToYv2fPvsV_QrIWJf6Q_ijro2JulRtQoeKcTUYc Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Domain-Id: None Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Domain-Name: None Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Identity-Status: Confirmed Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Is-Admin-Project: True Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Domain-Id: default Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Domain-Name: Default Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Name: admin Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Role: admin,reader,member Jul 20 22:38:27.484962 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Roles: admin,reader,member Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_015b89c7582349b2a89f8bbaea747017", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant: admin Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant-Name: admin Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User: admin Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Domain-Id: default Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Domain-Name: Default Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Id: 98f5d4c4be4845478aa0d31a1403d775 Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Name: admin Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: method: > Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: exception: Flavor 42 could not be found. Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: action_args: {'id': '42'} Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:38:27.486593 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:27.487845 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.489350 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-1301d461-e31a-47d9-b86e-7ddf8044e4f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:38:27.490608 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-1301d461-e31a-47d9-b86e-7ddf8044e4f4 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390940 Jul 20 22:38:27.490608 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 19/39] 10.222.0.81 () {60 vars in 1190 bytes} [Wed Jul 20 22:38:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:27.495975 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-7872eab3-4743-45ce-8efa-6126f0434e0d admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:27.499150 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:27.518633 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-7872eab3-4743-45ce-8efa-6126f0434e0d admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026176 Jul 20 22:38:27.519763 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 21/40] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Jul 20 22:38:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:38:27.529492 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-f723332a-b3b7-46aa-a589-b8e6b957b705 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:27.551458 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-f723332a-b3b7-46aa-a589-b8e6b957b705 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025699 Jul 20 22:38:27.551989 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 20/41] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Jul 20 22:38:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:38:27.561585 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-45c82d75-1db7-4e44-aba7-ea175dc7f473 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:27.567636 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.wsgi [None req-45c82d75-1db7-4e44-aba7-ea175dc7f473 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-45c82d75-1db7-4e44-aba7-ea175dc7f473 admin admin] Request method failure captured: Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Accept: application/json Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Accept-Encoding: gzip, deflate Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Connection: keep-alive Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Content-Length: 0 Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Host: 10.222.0.81 Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Openstack-Api-Version: compute 2.90 Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Openstack-System-Scope: None Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: User-Agent: python-novaclient Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Auth-Token: gAAAAABi2IPitWLkkomBdz4NFsq_4RKKPRgpq1lmKf48cCaCSM5GuTV--ACW-65Ddkla-WmRcfD5j2vrRLib2Gk_DD8UhmnCMgposoJQxHplIyyWrZlgH8na0PmNwGmlnYnUL8bgeBlYx8kGToYv2fPvsV_QrIWJf6Q_ijro2JulRtQoeKcTUYc Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Domain-Id: None Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Domain-Name: None Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Identity-Status: Confirmed Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Is-Admin-Project: True Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Domain-Id: default Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Domain-Name: Default Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Name: admin Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Role: admin,reader,member Jul 20 22:38:27.570886 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Roles: admin,reader,member Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_015b89c7582349b2a89f8bbaea747017", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant: admin Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant-Name: admin Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User: admin Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Domain-Id: default Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Domain-Name: Default Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Id: 98f5d4c4be4845478aa0d31a1403d775 Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Name: admin Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: method: > Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: exception: Flavor 42 could not be found. Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: action_args: {'id': '42'} Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:38:27.572441 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:27.573380 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:27.574545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-45c82d75-1db7-4e44-aba7-ea175dc7f473 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:38:27.575838 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-45c82d75-1db7-4e44-aba7-ea175dc7f473 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014731 Jul 20 22:38:27.575838 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 22/42] 10.222.0.81 () {60 vars in 1190 bytes} [Wed Jul 20 22:38:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:28.539942 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-f723332a-b3b7-46aa-a589-b8e6b957b705 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:28.541077 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-f723332a-b3b7-46aa-a589-b8e6b957b705 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 20 22:38:28.541483 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 21/43] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:29.070278 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-fc10b262-1734-40ae-a39b-f42d907a5c6d admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:29.075611 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.wsgi [None req-fc10b262-1734-40ae-a39b-f42d907a5c6d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-fc10b262-1734-40ae-a39b-f42d907a5c6d admin admin] Request method failure captured: Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Accept: application/json Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Accept-Encoding: gzip, deflate Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Connection: keep-alive Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Content-Length: 0 Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Host: 10.222.0.81 Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Openstack-Api-Version: compute 2.90 Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Openstack-System-Scope: None Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: User-Agent: python-novaclient Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Auth-Token: gAAAAABi2IPk00db7D-PCfSbDyv1tAZUIHzx_Ar6kTnljo0K3ezQE8Ow8GQg3XKyi8IeU66am-1klYJmz5vqIq0xszkiwfVr1azz1mkdFSFNX6TVlYNSvzqFnBdl2aIdBhNDZmudHQS2BP2EbsVywShv3wgvV_0RaCUBFCvyZPcqYGn2hDVMbj0 Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Domain-Id: None Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Domain-Name: None Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Identity-Status: Confirmed Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Is-Admin-Project: True Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Domain-Id: default Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Domain-Name: Default Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Name: admin Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Role: admin,reader,member Jul 20 22:38:29.077146 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Roles: admin,reader,member Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_015b89c7582349b2a89f8bbaea747017", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant: admin Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant-Name: admin Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User: admin Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Domain-Id: default Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Domain-Name: Default Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Id: 98f5d4c4be4845478aa0d31a1403d775 Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Name: admin Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: method: > Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: exception: Flavor 84 could not be found. Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: action_args: {'id': '84'} Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:38:29.078729 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:29.079632 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.080794 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-fc10b262-1734-40ae-a39b-f42d907a5c6d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:38:29.082121 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-fc10b262-1734-40ae-a39b-f42d907a5c6d admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.399867 Jul 20 22:38:29.082121 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 23/44] 10.222.0.81 () {60 vars in 1190 bytes} [Wed Jul 20 22:38:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:29.088246 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-7327af03-9244-43f2-a56d-ad16422663d8 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:29.102030 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-7327af03-9244-43f2-a56d-ad16422663d8 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017364 Jul 20 22:38:29.102550 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 22/45] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Jul 20 22:38:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:38:29.111777 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-1105ddc6-d7b0-4dc5-bcc4-327f3b624ecd admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:29.128089 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-1105ddc6-d7b0-4dc5-bcc4-327f3b624ecd admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019684 Jul 20 22:38:29.128627 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 24/46] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Jul 20 22:38:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:38:29.139888 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-727bccd2-995e-4b51-994e-c497ebc475b7 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:29.143563 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.wsgi [None req-727bccd2-995e-4b51-994e-c497ebc475b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-727bccd2-995e-4b51-994e-c497ebc475b7 admin admin] Request method failure captured: Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Accept: application/json Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Accept-Encoding: gzip, deflate Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Connection: keep-alive Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Content-Length: 0 Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Host: 10.222.0.81 Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Openstack-Api-Version: compute 2.90 Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Openstack-System-Scope: None Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: User-Agent: python-novaclient Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Auth-Token: gAAAAABi2IPk00db7D-PCfSbDyv1tAZUIHzx_Ar6kTnljo0K3ezQE8Ow8GQg3XKyi8IeU66am-1klYJmz5vqIq0xszkiwfVr1azz1mkdFSFNX6TVlYNSvzqFnBdl2aIdBhNDZmudHQS2BP2EbsVywShv3wgvV_0RaCUBFCvyZPcqYGn2hDVMbj0 Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Domain-Id: None Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Domain-Name: None Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Identity-Status: Confirmed Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Is-Admin-Project: True Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Domain-Id: default Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Domain-Name: Default Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Name: admin Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Role: admin,reader,member Jul 20 22:38:29.145083 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Roles: admin,reader,member Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_015b89c7582349b2a89f8bbaea747017", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant: admin Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant-Name: admin Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User: admin Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Domain-Id: default Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Domain-Name: Default Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Id: 98f5d4c4be4845478aa0d31a1403d775 Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Name: admin Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: method: > Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: exception: Flavor 84 could not be found. Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: action_args: {'id': '84'} Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:38:29.146670 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:29.147628 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:29.148701 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-727bccd2-995e-4b51-994e-c497ebc475b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:38:29.149704 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-727bccd2-995e-4b51-994e-c497ebc475b7 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012011 Jul 20 22:38:29.149704 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 23/47] 10.222.0.81 () {60 vars in 1190 bytes} [Wed Jul 20 22:38:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:30.117218 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-1105ddc6-d7b0-4dc5-bcc4-327f3b624ecd admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:30.118223 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-1105ddc6-d7b0-4dc5-bcc4-327f3b624ecd admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 20 22:38:30.118611 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 25/48] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:38:30.639332 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-558539c0-d1fc-4c6e-be8e-6aecc17ce89e admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:30.645620 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.wsgi [None req-558539c0-d1fc-4c6e-be8e-6aecc17ce89e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-558539c0-d1fc-4c6e-be8e-6aecc17ce89e admin admin] Request method failure captured: Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Accept: application/json Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Accept-Encoding: gzip, deflate Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Connection: keep-alive Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Content-Length: 0 Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Host: 10.222.0.81 Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Openstack-Api-Version: compute 2.90 Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Openstack-System-Scope: None Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: User-Agent: python-novaclient Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Auth-Token: gAAAAABi2IPmY_4RxXdW-rG03U_4-vv0_Sc3trrUJiVtB7KlzEN9PR8kPXyI6eG1bbJc7azYxwoFg8PqJ15cW1_sblQoIHvjhPVz8evDJ5FhnraGAXDubtOrQbx-F3pHM39v8cYGBDLFDKaCcSbaUdTpj_5cVC3P_ZfZBizeIgsORm0fYHDuMZk Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Domain-Id: None Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Domain-Name: None Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Identity-Status: Confirmed Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Is-Admin-Project: True Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Domain-Id: default Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Domain-Name: Default Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Project-Name: admin Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Role: admin,reader,member Jul 20 22:38:30.647177 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Roles: admin,reader,member Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_015b89c7582349b2a89f8bbaea747017", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant: admin Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-Tenant-Name: admin Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User: admin Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Domain-Id: default Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Domain-Name: Default Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Id: 98f5d4c4be4845478aa0d31a1403d775 Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: X-User-Name: admin Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: method: > Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: exception: Flavor 451 could not be found. Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: action_args: {'id': '451'} Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:38:30.648702 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:30.649664 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.650937 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-558539c0-d1fc-4c6e-be8e-6aecc17ce89e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110372) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:38:30.652215 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-558539c0-d1fc-4c6e-be8e-6aecc17ce89e admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391303 Jul 20 22:38:30.652215 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 24/49] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Jul 20 22:38:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:30.658166 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-602c059d-95c3-429c-93a5-b71e339035d5 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:30.672588 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-602c059d-95c3-429c-93a5-b71e339035d5 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018048 Jul 20 22:38:30.673122 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 26/50] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Jul 20 22:38:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:38:30.682504 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:30.697713 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018673 Jul 20 22:38:30.698234 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 25/51] 10.222.0.81 () {60 vars in 1210 bytes} [Wed Jul 20 22:38:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:38:30.708052 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-6c99c1b3-0765-4282-9d5a-e9030fddc8e3 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:30.713369 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.wsgi [None req-6c99c1b3-0765-4282-9d5a-e9030fddc8e3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-6c99c1b3-0765-4282-9d5a-e9030fddc8e3 admin admin] Request method failure captured: Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Accept: application/json Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Accept-Encoding: gzip, deflate Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Connection: keep-alive Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Content-Length: 0 Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Host: 10.222.0.81 Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Openstack-Api-Version: compute 2.90 Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Openstack-System-Scope: None Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: User-Agent: python-novaclient Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Auth-Token: gAAAAABi2IPmY_4RxXdW-rG03U_4-vv0_Sc3trrUJiVtB7KlzEN9PR8kPXyI6eG1bbJc7azYxwoFg8PqJ15cW1_sblQoIHvjhPVz8evDJ5FhnraGAXDubtOrQbx-F3pHM39v8cYGBDLFDKaCcSbaUdTpj_5cVC3P_ZfZBizeIgsORm0fYHDuMZk Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Domain-Id: None Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Domain-Name: None Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Identity-Status: Confirmed Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Is-Admin-Project: True Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Domain-Id: default Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Domain-Name: Default Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Project-Name: admin Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Role: admin,reader,member Jul 20 22:38:30.714874 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Roles: admin,reader,member Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_015b89c7582349b2a89f8bbaea747017", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/015b89c7582349b2a89f8bbaea747017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant: admin Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant-Id: 015b89c7582349b2a89f8bbaea747017 Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-Tenant-Name: admin Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User: admin Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Domain-Id: default Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Domain-Name: Default Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Id: 98f5d4c4be4845478aa0d31a1403d775 Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: X-User-Name: admin Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: method: > Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: exception: Flavor 451 could not be found. Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: action_args: {'id': '451'} Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:38:30.716492 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:30.717575 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: ERROR nova.api.openstack.wsgi Jul 20 22:38:30.718843 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-6c99c1b3-0765-4282-9d5a-e9030fddc8e3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110373) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:38:30.720070 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-6c99c1b3-0765-4282-9d5a-e9030fddc8e3 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012391 Jul 20 22:38:30.720070 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 27/52] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Jul 20 22:38:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:31.684802 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:31.685800 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 20 22:38:31.686210 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 26/53] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:38:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:32.222694 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-84ea08c0-8f00-4128-80bc-e1bdbac54da3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:38:32.323989 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-84ea08c0-8f00-4128-80bc-e1bdbac54da3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.492023 Jul 20 22:38:32.324528 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 28/54] 10.222.0.81 () {64 vars in 1235 bytes} [Wed Jul 20 22:38:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:38:33.303613 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:33.304661 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 20 22:38:33.305049 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 27/55] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:38:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:33.839443 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-08f185a2-059c-4550-b976-476811e2a511 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:38:33.919891 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-08f185a2-059c-4550-b976-476811e2a511 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.478592 Jul 20 22:38:33.920363 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 29/56] 10.222.0.81 () {64 vars in 1235 bytes} [Wed Jul 20 22:38:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:38:34.916131 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:34.917171 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 20 22:38:34.917626 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 28/57] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:35.440485 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-add8f30f-ebbf-4c70-9a6b-0008cd67a70d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:38:35.518515 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-add8f30f-ebbf-4c70-9a6b-0008cd67a70d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.463119 Jul 20 22:38:35.519130 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 30/58] 10.222.0.81 () {64 vars in 1235 bytes} [Wed Jul 20 22:38:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:38:36.485528 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:36.486693 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 20 22:38:36.487222 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 29/59] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:38:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:37.013651 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-9582fcfa-a3ae-45b6-b5a5-14758112b39e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:38:37.086749 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-9582fcfa-a3ae-45b6-b5a5-14758112b39e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.460135 Jul 20 22:38:37.087324 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 31/60] 10.222.0.81 () {64 vars in 1235 bytes} [Wed Jul 20 22:38:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:38:38.071900 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:38.072900 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 20 22:38:38.073294 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 30/61] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:38:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:38:38.616534 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-f822ef28-bdea-465d-94dd-86c7dd3f2151 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:38:38.636093 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-f822ef28-bdea-465d-94dd-86c7dd3f2151 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.417624 Jul 20 22:38:38.636553 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 32/62] 10.222.0.81 () {60 vars in 1202 bytes} [Wed Jul 20 22:38:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:39:30.867798 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:39:30.868810 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-4961c33b-3160-41b8-aa11-f4ffc0bbf728 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 20 22:39:30.869202 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 31/63] 10.222.0.81 () {54 vars in 930 bytes} [Wed Jul 20 22:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:39:30.879774 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:31.259410 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-29361119-c01e-4803-87d2-fe9eb2e4530c admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:39:31.278180 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-29361119-c01e-4803-87d2-fe9eb2e4530c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402951 Jul 20 22:39:31.278758 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 33/64] 10.222.0.81 () {60 vars in 1291 bytes} [Wed Jul 20 22:39:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:39:31.300935 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG dbcounter [-] [110372] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110372) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:31.305312 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-7558eace-4649-44bc-b96b-788e3be0c6aa admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:39:31.312882 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-7558eace-4649-44bc-b96b-788e3be0c6aa admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013427 Jul 20 22:39:31.313397 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 32/65] 10.222.0.81 () {60 vars in 1282 bytes} [Wed Jul 20 22:39:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:39:31.325095 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-b307f674-ac11-4a2a-a2fa-4ad67bb8f399 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:39:31.332911 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-b307f674-ac11-4a2a-a2fa-4ad67bb8f399 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011404 Jul 20 22:39:31.338224 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 34/66] 10.222.0.81 () {60 vars in 1285 bytes} [Wed Jul 20 22:39:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:39:31.344562 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:39:31.352490 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011466 Jul 20 22:39:31.352987 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 33/67] 10.222.0.81 () {60 vars in 1285 bytes} [Wed Jul 20 22:39:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:39:31.364234 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-789ac858-ea48-4a57-94ad-5f34142203fc admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:39:31.372285 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-789ac858-ea48-4a57-94ad-5f34142203fc admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011552 Jul 20 22:39:31.372783 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 35/68] 10.222.0.81 () {60 vars in 1282 bytes} [Wed Jul 20 22:39:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:43:17.926526 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:43:17.935128 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 20 22:43:17.935128 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 34/69] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:43:18.068990 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=6 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:18.211841 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-97c20d32-83c4-4100-b0f5-2d18ee101323 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:43:18.213091 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:18.213091 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 20 22:43:18.214282 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-97c20d32-83c4-4100-b0f5-2d18ee101323 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:43:18.214722 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-97c20d32-83c4-4100-b0f5-2d18ee101323 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:43:18.215545 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-97c20d32-83c4-4100-b0f5-2d18ee101323 admin admin] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:43:18.215977 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-97c20d32-83c4-4100-b0f5-2d18ee101323 admin admin] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:43:18.249634 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-97c20d32-83c4-4100-b0f5-2d18ee101323 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.181991 Jul 20 22:43:18.250114 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 36/70] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Jul 20 22:43:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:43:19.081809 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:43:19.082833 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 20 22:43:19.083241 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 35/71] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:43:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:43:19.274596 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-3ee56965-86a3-4a4f-a51f-ca8ad8644e9c admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:43:19.275792 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:19.275792 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 20 22:43:19.276979 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-3ee56965-86a3-4a4f-a51f-ca8ad8644e9c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:43:19.277419 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-3ee56965-86a3-4a4f-a51f-ca8ad8644e9c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:43:19.278204 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-3ee56965-86a3-4a4f-a51f-ca8ad8644e9c admin admin] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:43:19.278633 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-3ee56965-86a3-4a4f-a51f-ca8ad8644e9c admin admin] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:43:19.299182 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-3ee56965-86a3-4a4f-a51f-ca8ad8644e9c admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078202 Jul 20 22:43:19.299672 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 37/72] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Jul 20 22:43:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:43:30.537550 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:43:30.538839 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 20 22:43:30.539272 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 36/73] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:43:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:43:30.680546 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell0:SELECT=4 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:30.681271 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_cell1:SELECT=4 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:30.681882 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG dbcounter [-] [110373] Writing DB stats nova_api:SELECT=8 {{(pid=110373) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:30.729780 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-835138d7-b794-42c9-be7e-38f7403ac0c3 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:43:30.730939 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:30.730939 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 20 22:43:30.732190 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-835138d7-b794-42c9-be7e-38f7403ac0c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:43:30.732633 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-835138d7-b794-42c9-be7e-38f7403ac0c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:43:30.733416 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-835138d7-b794-42c9-be7e-38f7403ac0c3 admin admin] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:43:30.733873 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-835138d7-b794-42c9-be7e-38f7403ac0c3 admin admin] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:43:30.760842 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-835138d7-b794-42c9-be7e-38f7403ac0c3 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083830 Jul 20 22:43:30.760842 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 38/74] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Jul 20 22:43:30 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:43:31.592704 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: DEBUG nova.api.openstack.wsgi [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] Calling method '>' {{(pid=110372) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:43:31.593738 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: INFO nova.api.openstack.requestlog [None req-0916ab53-ebc2-4aa0-a60d-e7856232492c admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 20 22:43:31.594178 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: [pid: 110372|app: 0|req: 37/75] 10.222.0.81 () {56 vars in 1074 bytes} [Wed Jul 20 22:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:43:31.784630 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG nova.api.openstack.wsgi [None req-1252b81d-e688-4a24-b6f8-0ac6b9cb0da0 admin admin] Calling method '>' {{(pid=110373) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:43:31.785799 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:31.785799 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: warnings.warn(msg) Jul 20 22:43:31.787031 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-1252b81d-e688-4a24-b6f8-0ac6b9cb0da0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:43:31.787483 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-1252b81d-e688-4a24-b6f8-0ac6b9cb0da0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:43:31.788298 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-1252b81d-e688-4a24-b6f8-0ac6b9cb0da0 admin admin] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:43:31.788995 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: DEBUG oslo_concurrency.lockutils [None req-1252b81d-e688-4a24-b6f8-0ac6b9cb0da0 admin admin] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110373) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:43:31.810198 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: INFO nova.api.openstack.requestlog [None req-1252b81d-e688-4a24-b6f8-0ac6b9cb0da0 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077542 Jul 20 22:43:31.810745 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: [pid: 110373|app: 0|req: 39/76] 10.222.0.81 () {60 vars in 1193 bytes} [Wed Jul 20 22:43:31 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:44:31.247085 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: Wed Jul 20 22:44:31 2022 - graceful shutdown triggered... Jul 20 22:44:31.247603 dv-cinder-799871-38-iscsi devstack@n-api.service[110373]: Gracefully killing worker 2 (pid: 110373)... Jul 20 22:44:31.249326 dv-cinder-799871-38-iscsi devstack@n-api.service[110372]: Gracefully killing worker 1 (pid: 110372)... Jul 20 22:44:31.249966 dv-cinder-799871-38-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 22:44:32.248237 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: worker 1 buried after 1 seconds Jul 20 22:44:32.248658 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: worker 2 buried after 1 seconds Jul 20 22:44:32.248658 dv-cinder-799871-38-iscsi devstack@n-api.service[110371]: goodbye to uWSGI. Jul 20 22:44:32.250026 dv-cinder-799871-38-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 22:44:32.250683 dv-cinder-799871-38-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 22:44:32.253697 dv-cinder-799871-38-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 22:44:32.264668 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 22:44:32 2022] *** Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: nodename: dv-cinder-799871-38-iscsi Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: machine: x86_64 Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: clock source: unix Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: pcre jit disabled Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: detected number of CPU cores: 4 Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: current working directory: / Jul 20 22:44:32.266816 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: detected binary path: /usr/bin/uwsgi-core Jul 20 22:44:32.267619 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: your processes number limit is 47680 Jul 20 22:44:32.267619 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: your memory page size is 4096 bytes Jul 20 22:44:32.267619 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: detected max file descriptor number: 2048 Jul 20 22:44:32.267619 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: lock engine: pthread robust mutexes Jul 20 22:44:32.267619 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: thunder lock: enabled Jul 20 22:44:32.268101 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 22:44:32.268199 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 22:44:32.314817 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: Python main interpreter initialized at 0x55ffe97019c0 Jul 20 22:44:32.314817 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: python threads support enabled Jul 20 22:44:32.314817 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: your server socket listen backlog is limited to 100 connections Jul 20 22:44:32.314817 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: your mercy for graceful operations on workers is 90 seconds Jul 20 22:44:32.315379 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 22:44:32.315379 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: *** Operational MODE: preforking *** Jul 20 22:44:32.315593 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: *** uWSGI is running in multiple interpreter mode *** Jul 20 22:44:32.315593 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: spawned uWSGI master process (pid: 124892) Jul 20 22:44:32.315848 dv-cinder-799871-38-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 22:44:32.318027 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: spawned uWSGI worker 1 (pid: 124912, cores: 1) Jul 20 22:44:32.318027 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: spawned uWSGI worker 2 (pid: 124913, cores: 1) Jul 20 22:44:32.318027 dv-cinder-799871-38-iscsi devstack@n-api.service[124892]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 22:44:32.987579 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 22:44:32.988179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 22:44:34.184630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:44:34.184630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: from cryptography.utils import int_from_bytes Jul 20 22:44:34.185375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:44:34.185375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: from cryptography.utils import int_from_bytes Jul 20 22:44:34.186696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:44:34.186696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: from cryptography.utils import int_from_bytes Jul 20 22:44:34.187250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:44:34.187250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: from cryptography.utils import int_from_bytes Jul 20 22:44:36.513246 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 22:44:36.513874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 22:44:36.513985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 22:44:36.514323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 22:44:36.514551 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 22:44:36.514940 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.515296 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.515625 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.516334 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.516334 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.516614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.516893 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.517221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.517553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.517933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.518123 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.518453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-38-iscsi {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.518872 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.519217 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.519536 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.519861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.520172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.520510 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.520812 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.521318 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.523168 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.523492 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.523613 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 22:44:36.524014 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.524108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 22:44:36.524182 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.524413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 22:44:36.524638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.524914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.525149 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 22:44:36.525149 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 22:44:36.525575 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.525575 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.526001 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.526221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.526446 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.526667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.526893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.526893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.527323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-38-iscsi {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.527547 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.527765 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.527985 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.528204 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.528421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.528651 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.528885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.529068 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.529265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.529414 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.529569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.529750 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.529908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.530060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.530258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-38-iscsi {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.530447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.530614 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.530829 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.530992 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.531204 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.531358 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.531502 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.531660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.531852 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.532009 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.532153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.532286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.532422 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.532560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.532705 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.532836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.533003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.533186 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.533324 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.533472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.533615 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.533756 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.533886 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535034 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535165 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535305 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535405 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535499 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535666 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535748 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535844 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.535941 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536127 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-38-iscsi {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536562 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536654 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536751 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.536843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537189 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537275 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537369 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537369 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537537 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537705 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.537969 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.538061 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.538207 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.538351 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.538537 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.538654 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.538857 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.538978 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.539211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.539297 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.539525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.539614 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.539846 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.540108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.540192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.540272 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.540447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.540530 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.540761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.540852 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.541083 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.541165 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.541396 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.541490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.541701 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.541796 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.541952 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.542052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.542260 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.542359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.542582 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.542666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.542904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.543059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.543284 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.543440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.543605 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.543756 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.543904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.544048 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.544357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.544526 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.544661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.544751 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.544834 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.544956 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.545265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.545573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.545879 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.545984 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.546237 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.546347 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.546499 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.546599 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.546808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.546936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.547160 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.547255 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.547480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.547574 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.547805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.547907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.548114 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.548220 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.548500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.548743 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.548839 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.548944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.549043 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.549138 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.549326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.549433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.549642 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.549735 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.549957 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.550625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.550853 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.551035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.551189 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.551331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.551518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.551674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.551813 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.551954 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.552124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.552272 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.552434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.552611 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.552760 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.552921 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.553084 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.553231 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.553381 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.553525 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.553668 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.553823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.553975 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.554128 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.554291 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.554522 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.554682 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.554836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.555087 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.555253 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.555406 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.555549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.555692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.555849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.555993 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.556144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.556290 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.556432 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.556594 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.556748 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.556893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.557043 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.557197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.557342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.557485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.557641 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.557794 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.557938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.558080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.558223 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.558381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.558704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.558970 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.559147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.559303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.559456 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.559614 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.559759 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.559910 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.560069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.560217 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.560362 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.560531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.560689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.560856 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.560983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.561062 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.561351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.561481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.561566 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.561700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.561849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.561991 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.562130 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.562270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.562466 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.562633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.562788 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.562998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.563237 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.563384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.563384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.563557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.563636 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.563708 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.563777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.563845 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.564014 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.564160 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.564309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.564406 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.564515 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.564652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.564753 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.564848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.564941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.565034 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.565185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.565311 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.565489 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.565649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.565821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.565977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.566128 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.566305 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.566473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.566638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.566784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.566960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.567132 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.567324 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.567501 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.567654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.567808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.567964 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.568108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.568248 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.568553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:44:36.568902 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.569240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.569360 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.569585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.569697 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.569905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.570068 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.570222 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.570363 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.570556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.570707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.570862 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.571005 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.571227 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.571381 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.571547 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.571695 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.571872 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.572020 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.572185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.572333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.572500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.572651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.572799 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.572945 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.573119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.573268 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.573440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.573583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.573760 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.573908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.574077 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.574219 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.574394 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.574557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.574704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.574852 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.575001 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.575211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.575359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.575519 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.575660 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.575810 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.575972 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.576117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.576293 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.576448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.576679 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.576826 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.576967 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.577105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.577246 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.577399 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.577565 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.577721 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.577873 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.578017 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.578173 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.578327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.578506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.578660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.578820 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.578981 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.579191 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.579328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.579476 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.579624 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.579765 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.579932 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.580093 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.580252 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.580390 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.580540 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.580696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.580834 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.580983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.581132 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.581272 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.581412 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.581560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.581706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.581843 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.581982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.582157 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.582320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.582477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.582631 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.582783 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.582927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.583120 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.583288 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.583433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.583588 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.583740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.583885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.584028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.584178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.584328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.584493 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.584638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.584782 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.584933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.585084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.585235 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.585393 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.585544 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.585696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.585839 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.586032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.586189 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.586341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.586504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.586657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.586801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.586944 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.587169 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.587353 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.587502 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.587648 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.587797 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.587948 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.588101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.588246 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.588385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.588535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.588682 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.588824 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.588971 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.589116 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.589256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.589394 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.589491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.589686 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.589782 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.589999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.590092 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.590321 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.590463 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.590634 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.590729 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.590944 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.591100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.592244 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.592379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.592516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.592516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.592516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.592516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.592833 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.592914 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.593006 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.593099 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.593209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.593407 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.593522 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.593748 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.593857 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.594080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.594174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.594390 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.594490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.594717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.594811 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.595067 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.595164 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.595382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.595484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.595689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.595790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.596000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.596094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.596306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.596460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.596613 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.596706 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.597441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.597540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.597753 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.597911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.598061 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.598155 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.598365 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.598465 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.598672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.598772 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.598978 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.599133 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.599310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.599407 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.599637 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.599770 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.599947 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.600068 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.600764 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.600889 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.601011 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.601124 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.601263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.601395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.601531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.601664 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.601777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.601905 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.602040 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.602178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.602316 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.602479 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.602750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.602884 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.603047 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.603180 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.603322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.603469 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.603600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.603729 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.603865 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.603997 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.604135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.604274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.604565 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.604699 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.604828 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.604966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.605097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.605234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.605500 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.605644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.605818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606241 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606824 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.606914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.607100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.607213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.607423 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.607517 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.607748 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.607840 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.608075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.608178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.608388 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.608480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.608710 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.608803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.609021 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.609124 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.609357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.609488 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.609652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.609766 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.609984 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.610311 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.610742 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.611091 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.611422 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.611760 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.612079 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.613296 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.613651 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.613999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.614337 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.614670 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.615000 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.615280 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.615426 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.615675 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.615817 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.616004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.616329 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.616627 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.617051 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.617505 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.617750 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.618065 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.618172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.618383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.618598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.618694 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.619032 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.619147 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.619374 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.619666 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.619765 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.620016 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.620122 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.620347 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.620452 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.620659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.620978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.621315 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.621429 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.621621 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.621717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.621933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.622040 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.622250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.622361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.622563 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.622669 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.622918 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.623036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.623308 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.623418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.623601 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.623699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.623928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.624070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.624273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.624448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.624721 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.624809 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.624892 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.625126 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.625238 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.625487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.625654 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.625816 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.625994 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.626156 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.626441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.626582 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.626763 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.626882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.627121 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.627233 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.627438 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.627544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.627754 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.627859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.628082 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.628211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.628421 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.628559 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.628735 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.628872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.629051 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.629197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.629359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.629505 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.629673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.629809 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.629997 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.630131 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.630326 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.630584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.630730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.630924 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.631077 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.631296 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.631434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.631615 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.631743 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.631940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.632139 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.632274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.632424 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.632567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.632700 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.632859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.633004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.633172 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.633307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.633496 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.633649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.633810 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.633946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.634119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.634262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.634430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.634567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.634742 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.634888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.635065 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.635200 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.635377 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.635523 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.635689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.635834 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.635982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.636133 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.636303 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.636530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.636676 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.636854 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.636999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.637164 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.637309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.637475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.637611 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.637795 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.637932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.638110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.638375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.638521 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.638711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.638848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.639045 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.639199 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.639361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.639502 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.639669 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.639815 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.639981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.640128 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.640403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.640551 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.640684 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.640798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.640966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.641105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.641301 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.641444 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.641651 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.641782 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.642045 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.642187 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.642310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.642432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.642602 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.642734 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.642912 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.643152 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.643275 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.643388 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.643548 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.643673 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.643886 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.644016 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.644195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.644331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.644502 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.644623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.645769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.645956 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.646113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.646113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.646113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.646113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.646685 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.646831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.646977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.647183 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.647333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.647481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.647650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.647798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.647943 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.648104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.648252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.648407 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.648555 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.648701 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.648861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.649010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.649164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.649319 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.649468 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.649632 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.649790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.649790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.650067 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.650221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.650375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.650375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.650674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.650674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.650959 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.650959 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.651313 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.651479 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.651640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.651788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.651934 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.652099 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.652342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.652505 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.652660 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.652822 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.652977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.653132 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.653279 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.653434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.653591 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.653748 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.653902 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.654048 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.654193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.654348 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.654495 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.654640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.654787 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.654932 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.655099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.655289 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.655445 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.655609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.655764 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.655913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.656068 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.656223 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.656379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.656526 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.656679 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.656825 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.656986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.657143 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.657290 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.657435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.657590 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.657736 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.657901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.658049 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.658194 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.658347 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.658492 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.658645 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.658801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.658949 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.659132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.659280 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.659954 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.660128 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.660283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.660438 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.660584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.660730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.660884 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.661040 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.661194 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.661341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.661482 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.661599 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.661693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.661797 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662154 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662643 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662731 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662815 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.662907 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.663030 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.663136 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.663224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.663408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.663505 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.663713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.663808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.664018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.664121 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.664323 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.664416 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.664634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.664782 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.664935 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.665106 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.665341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.665435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.665527 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.665631 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.665814 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.666211 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.666355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.666450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.666551 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.666650 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.666784 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.666952 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.667215 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.667324 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.667443 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.667563 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.667747 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.667853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.668066 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.668168 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.668379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.668483 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.668693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.668786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.669036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.669350 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.669667 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.669840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.669984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.670161 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.670320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.670467 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.670626 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.670774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.670920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.671169 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.671323 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.671469 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.671629 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.671790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.671946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.672100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.672256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.672433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.672678 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.672835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.672992 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.673145 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.673293 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.673439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.673595 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.673744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.673911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.674066 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.674221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.674377 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.674377 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.674655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.674802 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.674957 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.675830 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.676006 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.676162 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.676317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.676317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.676613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.676769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.676927 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.677192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.677346 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.677500 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.677654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.677801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.677959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.677959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.678255 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.678546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.678857 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.679312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.679480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.679630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.679778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.679932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.680090 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.680246 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.680541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.680705 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.680862 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.681019 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.681167 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.681339 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.681488 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.681642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.681796 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.681968 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.682131 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.682292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.682439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.682716 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.682890 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.683141 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.683310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.683458 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.683617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.683763 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.683907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.684061 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.684223 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.684379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.684524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.684749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.684904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.685073 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.685388 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.685629 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.685942 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.686110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.686259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.686406 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.686566 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.686714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.686861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.687034 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.687221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.687471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.687633 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.687781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.687928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.687928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.688223 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.688519 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.688782 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.688936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.689125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.689287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.689436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.689596 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.689765 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.689927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.690083 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.690500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.690721 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.690890 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.691169 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.691325 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.691502 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.691688 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.691874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.692035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.692192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.692339 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.692493 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.692651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.692822 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.693076 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.693229 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.693384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.693531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.693856 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.694290 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.694501 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.694667 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.694837 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.695105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.695261 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.695410 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.695575 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.695732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.695879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.696210 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.696363 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.696511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.696657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.696803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.696949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.697104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.697258 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.697406 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.697672 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.697848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.698004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.698004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.698302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.698449 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.698596 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.698749 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.698911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.699101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.699265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.699413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.699560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.699714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.699886 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.700034 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.700180 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.700327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.700481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.700636 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.700792 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.700995 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.701156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.701312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.701459 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.701639 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.701870 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.702047 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.702203 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.702350 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.702495 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.702650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.702906 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.703085 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.703314 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.703465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.703623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.703780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.703928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.704085 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.704239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.704388 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.704544 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.704713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.704865 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.705018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.705172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.705319 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.705479 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.705634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.705781 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.705934 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.706107 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.706908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.707135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.707135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.707440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.707588 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.707845 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.707999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.708161 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.708316 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.708472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.708626 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.708781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.708939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.708939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.709234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.709381 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.709535 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.709681 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.709827 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.709982 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.710131 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.710284 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.710432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.710586 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.710746 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.710910 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.711136 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.711477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.711796 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.712123 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.712460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.712767 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.713087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.713410 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.713729 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.713883 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.714041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.714357 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.714510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.714658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.714812 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.714965 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.715315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.715489 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.715640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.715787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.716065 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.716231 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.716456 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.716610 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.716794 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.717168 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.717168 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.717474 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.717621 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.717769 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.718031 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.718184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.718331 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.718488 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.718636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.718783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.718936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.719136 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.719301 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.719450 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.719789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.720325 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.720644 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.720805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.720971 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.721127 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.721435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.721587 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.721779 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.722484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.722649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.722805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.722952 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.723150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.723298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.723478 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.723725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.723893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.723893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.724204 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.724369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.724551 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.724706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.724867 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.725029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.725183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.725183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.725488 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.725649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.725803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.725963 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.726118 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.726279 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.726441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.726605 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.726769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.726933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.727268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.727441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.727615 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.727773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.727926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.728189 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.728353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.728515 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.728669 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.728843 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.728997 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.729151 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.729320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.729560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.729560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.729871 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.730032 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.730194 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.730362 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.730516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.730669 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.730822 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.730986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.731193 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.731358 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.731521 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.731683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.731837 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.731998 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.732153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.732315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.732484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.732637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.732637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.732938 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.733099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.733266 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.733444 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.733606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.733851 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.734012 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.734179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.734342 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.734496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.734649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.734809 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.734970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.735177 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.735333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.735492 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.735655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.735807 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.735968 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.736134 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.736290 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.736442 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.736760 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.736930 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.737093 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.737413 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.737625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.737794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.737957 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.738110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.738110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.738548 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.738710 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.739031 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.739271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.739538 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.739810 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.740069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.740069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.740398 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.740558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.740712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.740910 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.741073 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.741389 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.741732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.741916 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.742153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.742878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.743126 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.743291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.743291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.743619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.743788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.744095 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.744095 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.744388 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.744541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.744705 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.744858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.745021 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.745349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.745521 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.745929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.746107 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.746263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.746545 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.746707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.746860 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.747062 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.747241 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.747580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.747741 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.747904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.748058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.748231 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.748400 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.748554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.748717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.748879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.749143 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.749329 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.749484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.749645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.749799 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.749951 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.750117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.750281 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.750447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.750608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.750773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.750936 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.751129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.751296 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.751450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.751602 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.751765 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.752247 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.752429 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.752605 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.752761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.752936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.753127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.753296 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.753467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.753630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.753785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.754060 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.754231 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.754385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.754553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.754708 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.754867 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.755079 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.755376 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.755693 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.756010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.756320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.756647 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.756963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.757273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.757633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.757905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.758453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.758858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.759218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.759402 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.759573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.759729 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.759923 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.760084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.760273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.760441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.760605 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.760776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.760937 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.761100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.761253 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.761510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.761682 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.761892 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.762060 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.762220 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.762382 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.762550 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.762706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.762860 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.763075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.763290 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.763462 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.763631 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.763804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.763966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.764147 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.764403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.764573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.764737 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.764892 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.765052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.765213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.765448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.765784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.765973 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.766130 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.766297 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.766451 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.766614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.766778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.766933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.767124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.767289 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.767453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.767626 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.767948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.767948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.768269 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.768445 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.768608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.768608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.769617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.769774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.769937 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.770100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.770256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.770424 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.770580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.770750 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.770908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.771137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.771327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.771493 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.771656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.771810 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.771964 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.771964 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.771964 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.772734 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.773065 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.773381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.773713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.774230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.774642 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.775320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.775696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.776327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.776507 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.776672 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.776902 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.777101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.777262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.777417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.777615 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.777775 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.778193 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.778370 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.778370 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.778664 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.778823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.778986 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.779252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.779685 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.779848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.780015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.780177 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.780342 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.780497 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.780652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.780832 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.780999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.781153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.781153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.781502 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.781502 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.781502 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.781933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.782087 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.782251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.782251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.782550 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.782726 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.782900 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.783090 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.800081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.800334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.800499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.800794 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.800979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.801232 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.801400 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.801556 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.801712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.801874 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.802072 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.802334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.802503 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.802660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.802832 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.803090 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.803265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.803432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.803601 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.803764 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.803976 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.804140 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.804323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.804481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.804635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.804814 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.804977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.805134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.805299 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.805475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.805743 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.805905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.806060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.806226 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.806393 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.806563 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.806717 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.806872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.807124 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.807300 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.807583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.807755 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.807911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.808067 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.808220 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.808618 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.808780 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.808943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.809113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.809276 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.809440 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.809605 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.809780 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.810238 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.810552 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.810552 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.811053 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.811252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.811517 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.811685 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.811912 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.812077 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.812248 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.812541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.812713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.812869 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.813024 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.813024 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.813469 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.813469 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.813809 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.813974 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.814158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.814323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.814498 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.814662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.814818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.814980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.815164 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.815333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.815510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.815723 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.816009 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.816170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.816327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.816503 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.816660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.816660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.816962 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.817126 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.817293 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.817460 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.817615 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.817789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.817952 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.818115 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.818277 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.818460 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.818857 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.819050 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.819224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.819380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.819626 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.819785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.819991 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.820588 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.820767 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.820925 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.821262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.821428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.821786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.821950 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.822106 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.822273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.822439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.822815 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.822977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.823216 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.823496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.823667 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.823836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.823836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124912) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 22:44:36.824154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.824154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.824154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.824154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.824154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.824154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.824154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.824154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.825328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.825328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.825328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.825328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.825328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.825328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.825328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.825328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.826677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.826677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.826677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.826677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.826677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.826677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.826677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.826677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.827882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.827882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.827882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.827882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.827882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.827882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.827882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.827882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.828788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.828788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.828788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.828788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.828788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.828788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.828788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.828788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.829623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.829623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.829623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.829623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.829623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.829623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.829623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.829623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:44:36.832276 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 22:44:36.961163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO dbcounter [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Registered counter for database nova_api Jul 20 22:44:36.982098 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_db.sqlalchemy.engines [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:44:36.987281 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO dbcounter [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Registered counter for database nova_api Jul 20 22:44:36.989127 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writer thread running {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:44:37.006988 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_db.sqlalchemy.engines [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:44:37.015082 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writer thread running {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:44:37.046162 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.context [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac8e65b0-7529-4d82-95f8-8407fdc93621(cell1) {{(pid=124912) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 22:44:37.050389 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:44:37.052020 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:44:37.052825 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:44:37.054856 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:44:37.058014 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO dbcounter [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Registered counter for database nova_cell0 Jul 20 22:44:37.063614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO dbcounter [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Registered counter for database nova_cell1 Jul 20 22:44:37.071518 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_db.sqlalchemy.engines [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:44:37.073794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_db.sqlalchemy.engines [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:44:37.076783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.context [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ac8e65b0-7529-4d82-95f8-8407fdc93621(cell1) {{(pid=124913) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 22:44:37.078939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writer thread running {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:44:37.080921 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:44:37.082235 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writer thread running {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:44:37.083173 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:44:37.083968 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:44:37.085970 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:44:37.088852 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO dbcounter [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Registered counter for database nova_cell0 Jul 20 22:44:37.093538 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO dbcounter [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Registered counter for database nova_cell1 Jul 20 22:44:37.100982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_db.sqlalchemy.engines [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:44:37.102726 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_db.sqlalchemy.engines [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:44:37.110036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writer thread running {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:44:37.112974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writer thread running {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:44:37.226913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO dbcounter [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Registered counter for database nova_cell0 Jul 20 22:44:37.234018 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_db.sqlalchemy.engines [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124912) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:44:37.238546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writer thread running {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:44:37.256994 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO dbcounter [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Registered counter for database nova_cell0 Jul 20 22:44:37.263723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_db.sqlalchemy.engines [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:44:37.268094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writer thread running {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:44:37.556917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: WARNING keystonemiddleware.auth_token [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 22:44:37.564315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: WARNING keystonemiddleware.auth_token [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 22:44:37.586196 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: WARNING keystonemiddleware.auth_token [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 22:44:37.593541 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: WARNING keystonemiddleware.auth_token [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 22:44:37.929988 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: WARNING keystonemiddleware.auth_token [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 22:44:37.936292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: WARNING keystonemiddleware.auth_token [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 22:44:37.936531 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: WARNING keystonemiddleware.auth_token [None req-f0672c21-1289-481a-abfe-ebbe334a9549 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 22:44:37.943688 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: WARNING keystonemiddleware.auth_token [None req-8532d2b3-b30e-4219-84e2-9b6ad2f6a3c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 22:44:37.943842 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ffe97019c0 pid: 124912 (default app) Jul 20 22:44:37.950212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ffe97019c0 pid: 124913 (default app) Jul 20 22:45:20.372487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:20.374316 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:20.375903 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:20.377332 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:21.586616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a3852b0d-21ca-4116-a02a-4454b5262342 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Action: 'create', calling method: .version_select at 0x7fe251ea0d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1691698516"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:24.176386 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a3852b0d-21ca-4116-a02a-4454b5262342 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.825405 Jul 20 22:45:24.177031 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1154 bytes} [Wed Jul 20 22:45:20 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3828 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 22:45:24.197652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:24.198940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:24.206391 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:24.207614 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:24.595499 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9e061f6f-b3fe-42eb-8db0-1009367394fc tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251e7c9d0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:25.123557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9e061f6f-b3fe-42eb-8db0-1009367394fc tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5" status: 200 len: 345 microversion: 2.1 time: 0.936409 Jul 20 22:45:25.124154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 1/2] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:24 2022] GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 => generated 345 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:26.138570 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8e9e5b70-d803-4d4e-b8f4-1ba8bd9cae8b tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251cfdb80>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:26.237528 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8e9e5b70-d803-4d4e-b8f4-1ba8bd9cae8b tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5" status: 200 len: 346 microversion: 2.1 time: 0.104969 Jul 20 22:45:26.238098 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 2/3] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:26 2022] GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:26.255290 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-185a87df-4ca4-4135-8f7c-869b5aa35cfb tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Action: 'create', calling method: .version_select at 0x7fe251d41a60>, body: {"snapshot": {"volume_id": "5921a9c8-60f7-44e3-8292-e5b92f8062a5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-516866927"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:27.150179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-185a87df-4ca4-4135-8f7c-869b5aa35cfb tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.904272 Jul 20 22:45:27.150940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 2/4] 10.222.0.81 () {60 vars in 1161 bytes} [Wed Jul 20 22:45:26 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:27.166723 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8e90251d-d275-495f-9ce8-6cf66725eddc tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251cfddc0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:27.270612 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8e90251d-d275-495f-9ce8-6cf66725eddc tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.112574 Jul 20 22:45:27.271286 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 3/5] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:27 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:45:27.281452 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ec544733-1460-428c-bf14-b8ce897449b7 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d41c10>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:27.397878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ec544733-1460-428c-bf14-b8ce897449b7 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.120421 Jul 20 22:45:27.398621 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 3/6] 10.222.0.81 () {58 vars in 1139 bytes} [Wed Jul 20 22:45:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:27.411809 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3383cc3d-fa21-4f19-8b39-89d6799f3f82 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d143a0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:27.462061 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3383cc3d-fa21-4f19-8b39-89d6799f3f82 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.056566 Jul 20 22:45:27.462860 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 4/7] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:27 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:45:28.475310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7710d96e-e693-438a-8767-9cc955b2d004 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d07790>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:28.517412 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7710d96e-e693-438a-8767-9cc955b2d004 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.046302 Jul 20 22:45:28.519195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:28 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:29.530291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3b50afb0-4994-4868-a7ec-bbf4e77f0151 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d14a60>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:29.607221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3b50afb0-4994-4868-a7ec-bbf4e77f0151 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.080514 Jul 20 22:45:29.608064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 5/9] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:29 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:30.618361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-63776ef3-3b98-45e2-a7a4-4210835889a8 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d07ee0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:30.680136 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-63776ef3-3b98-45e2-a7a4-4210835889a8 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.065489 Jul 20 22:45:30.684495 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 5/10] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:30 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:31.693024 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c86eb540-6fff-4686-8bd5-79428415e5d2 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d14ca0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:31.728401 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c86eb540-6fff-4686-8bd5-79428415e5d2 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.038374 Jul 20 22:45:31.735333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 6/11] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:31 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:32.741213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-48b590c5-fc36-499e-9eac-d4d7a2df8bfc tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d078b0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:32.802908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-48b590c5-fc36-499e-9eac-d4d7a2df8bfc tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.066434 Jul 20 22:45:32.803841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 6/12] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:32 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:45:33.817108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4eed2ab2-4e6a-4339-a829-cff15df48ffd tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d145e0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:33.877273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4eed2ab2-4e6a-4339-a829-cff15df48ffd tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.064612 Jul 20 22:45:33.883174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 7/13] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:33 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:34.512151 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f57b02ef-d632-4d23-8f54-374bb7c19b91 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'create', calling method: .version_select at 0x7fe251d07310>, body: {"keypair": {"name": "tempest-keypair-1262118265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw3sZmDnlNMKGFP3BRIIfuMtZYYigmhIOiAe26y3zT1TVvOueXcTHnFHofQcWer++qK1aUFHOEMsUpD7no1f5spzaBaFRlF5kBljmYIXphbH9cMxnoX1HZ6dbrT57lL+A=="}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:34.650488 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-f57b02ef-d632-4d23-8f54-374bb7c19b91 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Getting quotas for project 90ac023afcb44b5097539298076c0838. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:45:34.664941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-f57b02ef-d632-4d23-8f54-374bb7c19b91 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Getting quotas for user 0cf649be0c48492f8926f4436cbb3d6d and project 90ac023afcb44b5097539298076c0838. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:45:34.890184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f1ab8c22-a307-4319-ac84-667a1fd8e7b4 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251cfd940>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:34.944779 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f1ab8c22-a307-4319-ac84-667a1fd8e7b4 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 287 microversion: 2.1 time: 0.059525 Jul 20 22:45:34.945428 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 8/14] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:34 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:34.956070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1757887b-4fb1-4396-bb40-b4d866b484fb tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d20160>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:34.971865 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f57b02ef-d632-4d23-8f54-374bb7c19b91 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.996186 Jul 20 22:45:34.976877 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 7/15] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 22:45:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:35.140017 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1757887b-4fb1-4396-bb40-b4d866b484fb tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 202 len: 0 microversion: 2.1 time: 0.187995 Jul 20 22:45:35.144993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 9/16] 10.222.0.81 () {58 vars in 1253 bytes} [Wed Jul 20 22:45:34 2022] DELETE /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 22:45:35.152069 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-34e191c7-9308-4ed9-b6e8-0bafebac57e9 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251ce4f70>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:35.232360 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-34e191c7-9308-4ed9-b6e8-0bafebac57e9 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 200 len: 286 microversion: 2.1 time: 0.086494 Jul 20 22:45:35.233245 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 8/17] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:35 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:36.246035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-26fe209f-a1a1-47bf-abe6-548918aef6fe tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251cfda60>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:36.330173 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-26fe209f-a1a1-47bf-abe6-548918aef6fe tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] HTTP exception thrown: Snapshot 1336a968-7c7a-49a6-a2f7-309e82c2c556 could not be found. Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-26fe209f-a1a1-47bf-abe6-548918aef6fe tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Request method failure captured: Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 HTTP/1.1 Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWAeO34zQq4dKEXgk31tp2Q0anWyxqKT55bqp42RwQQphXVR5_VkCv-_TYOwOl9u59q_c1UzPhHcsu8EXGXtJsvSQKnLHLFKeCuBQB8pjL3Vo2fybcQr6NX-ibE8zh0xxtNAv__Dc0LD_pI6CGywguuzaW2bD5DiAWT_E4ecOTyTRk Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 10dcd3a5465d434cbb63e588e4d4df8c Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:45:36.336455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_10dcd3a5465d434cbb63e588e4d4df8c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 10dcd3a5465d434cbb63e588e4d4df8c Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-VolumesSnapshotsTestJSON-1445409695-project Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 906771f309044b178b9218d79390e35d Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1445409695-project Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Snapshot 1336a968-7c7a-49a6-a2f7-309e82c2c556 could not be found. Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '1336a968-7c7a-49a6-a2f7-309e82c2c556'} Jul 20 22:45:36.337453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1336a968-7c7a-49a6-a2f7-309e82c2c556 could not be found. (HTTP 404) (Request-ID: req-423b1b18-0bdb-45fb-9a03-1fe6dec694d0) Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:36.338049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:45:36.338960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1336a968-7c7a-49a6-a2f7-309e82c2c556 could not be found. Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 22:45:36.340878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1336a968-7c7a-49a6-a2f7-309e82c2c556 could not be found. Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1336a968-7c7a-49a6-a2f7-309e82c2c556 could not be found. Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-26fe209f-a1a1-47bf-abe6-548918aef6fe tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Returning 404 to user: Snapshot 1336a968-7c7a-49a6-a2f7-309e82c2c556 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:45:36.342450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-26fe209f-a1a1-47bf-abe6-548918aef6fe tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556" status: 404 len: 111 microversion: 2.1 time: 0.097967 Jul 20 22:45:36.344029 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 10/18] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:45:36 2022] GET /compute/v2.1/os-snapshots/1336a968-7c7a-49a6-a2f7-309e82c2c556 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:45:36.347667 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f31e790b-74ce-4468-ac13-4b1a5c42e4d7 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251c99670>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:37.100387 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f31e790b-74ce-4468-ac13-4b1a5c42e4d7 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5" status: 202 len: 0 microversion: 2.1 time: 0.756641 Jul 20 22:45:37.103984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 9/19] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:45:36 2022] DELETE /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:45:37.119097 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-169cc4a3-ebd8-4f1e-a0f4-eb4b1f6cf210 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe252690040>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:37.229807 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-169cc4a3-ebd8-4f1e-a0f4-eb4b1f6cf210 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5" status: 200 len: 345 microversion: 2.1 time: 0.124366 Jul 20 22:45:37.230930 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 11/20] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:37 2022] GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:37.528367 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1426186953", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:37.773078 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] validate_networks() for [('efcbc23a-538d-4e8a-a0a8-c637f267412a', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:45:38.242714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9f82cae2-9705-495a-b82a-3087c8268526 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d205e0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:38.303374 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-9f82cae2-9705-495a-b82a-3087c8268526 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] HTTP exception thrown: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9f82cae2-9705-495a-b82a-3087c8268526 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Request method failure captured: Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 HTTP/1.1 Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWAeO34zQq4dKEXgk31tp2Q0anWyxqKT55bqp42RwQQphXVR5_VkCv-_TYOwOl9u59q_c1UzPhHcsu8EXGXtJsvSQKnLHLFKeCuBQB8pjL3Vo2fybcQr6NX-ibE8zh0xxtNAv__Dc0LD_pI6CGywguuzaW2bD5DiAWT_E4ecOTyTRk Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 10dcd3a5465d434cbb63e588e4d4df8c Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:45:38.305911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_10dcd3a5465d434cbb63e588e4d4df8c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 10dcd3a5465d434cbb63e588e4d4df8c Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-VolumesSnapshotsTestJSON-1445409695-project Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 906771f309044b178b9218d79390e35d Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1445409695-project Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '5921a9c8-60f7-44e3-8292-e5b92f8062a5'} Jul 20 22:45:38.307218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. (HTTP 404) (Request-ID: req-5180284f-c489-4396-9fd5-c9d57d7bbc3f) Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.308094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:45:38.309192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 22:45:38.310287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.311349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9f82cae2-9705-495a-b82a-3087c8268526 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Returning 404 to user: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:45:38.312065 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9f82cae2-9705-495a-b82a-3087c8268526 tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5" status: 404 len: 109 microversion: 2.1 time: 0.070617 Jul 20 22:45:38.319378 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 12/21] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:38 2022] GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:45:38.326717 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-460fde8a-3b9a-4613-ad24-f08e073ab7ea tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251c893a0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:38.446283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-460fde8a-3b9a-4613-ad24-f08e073ab7ea tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] HTTP exception thrown: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-460fde8a-3b9a-4613-ad24-f08e073ab7ea tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Request method failure captured: Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: DELETE /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 HTTP/1.1 Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWAeO34zQq4dKEXgk31tp2Q0anWyxqKT55bqp42RwQQphXVR5_VkCv-_TYOwOl9u59q_c1UzPhHcsu8EXGXtJsvSQKnLHLFKeCuBQB8pjL3Vo2fybcQr6NX-ibE8zh0xxtNAv__Dc0LD_pI6CGywguuzaW2bD5DiAWT_E4ecOTyTRk Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 10dcd3a5465d434cbb63e588e4d4df8c Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:45:38.448260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_10dcd3a5465d434cbb63e588e4d4df8c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 10dcd3a5465d434cbb63e588e4d4df8c Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-VolumesSnapshotsTestJSON-1445409695-project Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 906771f309044b178b9218d79390e35d Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1445409695-project Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '5921a9c8-60f7-44e3-8292-e5b92f8062a5'} Jul 20 22:45:38.449351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. (HTTP 404) (Request-ID: req-77290a33-8be7-4b16-b075-b7766502f418) Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.449987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:45:38.451535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 22:45:38.456052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-460fde8a-3b9a-4613-ad24-f08e073ab7ea tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Returning 404 to user: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-460fde8a-3b9a-4613-ad24-f08e073ab7ea tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5" status: 404 len: 109 microversion: 2.1 time: 0.129151 Jul 20 22:45:38.456993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 13/22] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:45:38 2022] DELETE /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:45:38.468011 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2cec0786-9896-4bd3-bfaf-95e068ebb48b tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Calling method '.version_select at 0x7fe251d20700>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:38.544896 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-2cec0786-9896-4bd3-bfaf-95e068ebb48b tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] HTTP exception thrown: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2cec0786-9896-4bd3-bfaf-95e068ebb48b tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Request method failure captured: Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 HTTP/1.1 Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWAeO34zQq4dKEXgk31tp2Q0anWyxqKT55bqp42RwQQphXVR5_VkCv-_TYOwOl9u59q_c1UzPhHcsu8EXGXtJsvSQKnLHLFKeCuBQB8pjL3Vo2fybcQr6NX-ibE8zh0xxtNAv__Dc0LD_pI6CGywguuzaW2bD5DiAWT_E4ecOTyTRk Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 10dcd3a5465d434cbb63e588e4d4df8c Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:45:38.549372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_10dcd3a5465d434cbb63e588e4d4df8c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/10dcd3a5465d434cbb63e588e4d4df8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 10dcd3a5465d434cbb63e588e4d4df8c Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1445409695 Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-VolumesSnapshotsTestJSON-1445409695-project Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 906771f309044b178b9218d79390e35d Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1445409695-project Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '5921a9c8-60f7-44e3-8292-e5b92f8062a5'} Jul 20 22:45:38.550437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. (HTTP 404) (Request-ID: req-0c409acc-02ee-4f15-9d01-1f61aeb7c406) Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.551164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:45:38.552118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 22:45:38.553041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. Jul 20 22:45:38.553917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:45:38.557106 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2cec0786-9896-4bd3-bfaf-95e068ebb48b tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] Returning 404 to user: Volume 5921a9c8-60f7-44e3-8292-e5b92f8062a5 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:45:38.558298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2cec0786-9896-4bd3-bfaf-95e068ebb48b tempest-VolumesSnapshotsTestJSON-1445409695 tempest-VolumesSnapshotsTestJSON-1445409695-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5" status: 404 len: 109 microversion: 2.1 time: 0.103707 Jul 20 22:45:38.559420 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 14/23] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:38 2022] GET /compute/v2.1/os-volumes/5921a9c8-60f7-44e3-8292-e5b92f8062a5 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:45:40.887948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:45:40.888449 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:45:40.889092 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:45:40.889823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:45:40.890399 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:45:40.902252 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:40.903434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:40.904553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:40.907607 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:40.948569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Getting quotas for project 55c688e93c2b414ca86a3c2f9ec84798. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:45:40.956690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Getting quotas for user 1ed9249b2a9b42d9972ed71c04f2c888 and project 55c688e93c2b414ca86a3c2f9ec84798. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:45:40.989502 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:45:41.006976 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:45:41.220928 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0a7362e5-2cf8-45ae-ac43-6755c752fdd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.058706 Jul 20 22:45:41.221963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 10/24] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:45:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 4060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:45:41.232384 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-aec32cae-5b93-40c2-809c-f04e3a00beab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: .version_select at 0x7fe2526900d0>, body: {"keypair": {"name": "tempest-keypair-1442648441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINotuMlLAL7RTaFfITZETFZLrZixxHwdwARMtr/4cGggV2q5KwiadeOYEea+stDSzQO4R4vkysAtZtCKR40MRPe9qP/P/ychCekbLcdKCJRzVMzZ9K+1dZvf/nkF1GscQ=="}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:41.266050 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cae7e9b3-2909-45f3-8cda-e234b25ac421 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:41.266732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cae7e9b3-2909-45f3-8cda-e234b25ac421 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:41.327274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-aec32cae-5b93-40c2-809c-f04e3a00beab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for project f733781536584f80acfc325bf8444536. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:45:41.337841 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-aec32cae-5b93-40c2-809c-f04e3a00beab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for user 3e072e59bf3e46aaa062ec85b0e2c91a and project f733781536584f80acfc325bf8444536. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:45:41.480791 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cae7e9b3-2909-45f3-8cda-e234b25ac421 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:41.492916 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-aec32cae-5b93-40c2-809c-f04e3a00beab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.627087 Jul 20 22:45:41.497081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 15/25] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 22:45:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:41.500230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cae7e9b3-2909-45f3-8cda-e234b25ac421 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1222 microversion: 2.1 time: 0.255492 Jul 20 22:45:41.500910 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 11/26] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:41 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1222 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:42.337929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-273951669", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:42.436414 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1555520223", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "networks": [{"uuid": "33ffcf4d-7a0e-4b55-9b5e-f16d1fe19cf5"}]}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:42.470389 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] validate_networks() for [('efcbc23a-538d-4e8a-a0a8-c637f267412a', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:45:42.761259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] validate_networks() for [('33ffcf4d-7a0e-4b55-9b5e-f16d1fe19cf5', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:45:43.513080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:45:43.514570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:45:43.515502 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:45:43.516628 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:45:43.517062 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:45:43.533910 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:43.534547 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:43.535966 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:43.536413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:43.555268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Getting quotas for project 55c688e93c2b414ca86a3c2f9ec84798. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:45:43.559558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Getting quotas for user 1ed9249b2a9b42d9972ed71c04f2c888 and project 55c688e93c2b414ca86a3c2f9ec84798. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:45:43.572869 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:45:43.575178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:45:43.722334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-49de3250-b9e8-4f25-bf13-1f01ee61d598 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.389971 Jul 20 22:45:43.724418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 12/27] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:45:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:45:43.733001 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-494147317", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b15c8654-25e9-4d25-a03d-08719b813dd0"}], "security_groups": [{"name": "tempest-securitygroup--708605131"}], "key_name": "tempest-keypair-1262118265", "user_data": "}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:44.179119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] validate_networks() for [('b15c8654-25e9-4d25-a03d-08719b813dd0', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:45:45.038839 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:45:45.039679 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:45:45.040435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:45:45.041877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:45:45.042484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:45:45.066049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:45.069348 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:45.072776 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:45.074009 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:45.184114 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Getting quotas for project 788c1d44ad5d442e8ec58f1d76ae649b. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:45:45.198223 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Getting quotas for user 1b458e3837be425bba1f880895918287 and project 788c1d44ad5d442e8ec58f1d76ae649b. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:45:45.231489 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:45:45.234472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:45:45.526285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cbb89b9a-efe9-4625-8405-b112bc4615d6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.027818 Jul 20 22:45:45.527998 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 16/28] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:45:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:45:45.532943 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-74c78261-5bb2-4751-8b74-5f10c2216021 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:45.542700 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-74c78261-5bb2-4751-8b74-5f10c2216021 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:45.786994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-74c78261-5bb2-4751-8b74-5f10c2216021 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:45.809295 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-74c78261-5bb2-4751-8b74-5f10c2216021 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1221 microversion: 2.1 time: 0.280650 Jul 20 22:45:45.810610 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 17/29] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:45 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1221 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:46.096702 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:45:46.104927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:45:46.104927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:45:46.104927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:45:46.104927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:45:46.117068 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:46.118663 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:46.120570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:46.132490 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:46.179173 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5076125e-f71a-447e-8355-5f177e0a99e7 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Action: 'create', calling method: .version_select at 0x7fe25134bf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-155639992", "metadata": {"Type": "work"}}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:46.217682 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Getting quotas for project 90ac023afcb44b5097539298076c0838. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:45:46.228006 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Getting quotas for user 0cf649be0c48492f8926f4436cbb3d6d and project 90ac023afcb44b5097539298076c0838. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:45:46.247627 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:45:46.250191 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:45:46.498064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-150699d6-4f0b-4afb-95f7-9d4044b9b713 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.772276 Jul 20 22:45:46.508010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 13/30] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:45:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:45:46.517037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d3bfae7f-342e-45e2-9283-7967220f25a9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:46.517955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d3bfae7f-342e-45e2-9283-7967220f25a9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:46.657735 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d3bfae7f-342e-45e2-9283-7967220f25a9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:46.666553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d3bfae7f-342e-45e2-9283-7967220f25a9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1215 microversion: 2.1 time: 0.156556 Jul 20 22:45:46.667153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 14/31] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:46 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:46.714208 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8aa082c2-2160-4e43-bb55-3746a13763ac tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:46.760366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8aa082c2-2160-4e43-bb55-3746a13763ac tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:47.341521 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8aa082c2-2160-4e43-bb55-3746a13763ac tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:47.355518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8aa082c2-2160-4e43-bb55-3746a13763ac tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1237 microversion: 2.1 time: 0.669303 Jul 20 22:45:47.356113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 15/32] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:46 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1237 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:47.374136 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-00910797-3caf-4256-b70d-86a48f01a44a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:47.374890 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-00910797-3caf-4256-b70d-86a48f01a44a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:47.397571 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-00910797-3caf-4256-b70d-86a48f01a44a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:47.400321 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-00910797-3caf-4256-b70d-86a48f01a44a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:47.405307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-00910797-3caf-4256-b70d-86a48f01a44a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:47.405948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-00910797-3caf-4256-b70d-86a48f01a44a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:47.656623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5076125e-f71a-447e-8355-5f177e0a99e7 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.844571 Jul 20 22:45:47.658319 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 18/33] 10.222.0.81 () {60 vars in 1155 bytes} [Wed Jul 20 22:45:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1847 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 22:45:47.675615 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c38a6b6a-6c56-486f-9bca-192c5e1260a4 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe251333e50>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:47.855312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c38a6b6a-6c56-486f-9bca-192c5e1260a4 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 200 len: 352 microversion: 2.1 time: 0.183457 Jul 20 22:45:47.860340 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 19/34] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:47 2022] GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:47.861287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e6f27381-872c-4d23-8275-30e11c898574 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:47.861850 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e6f27381-872c-4d23-8275-30e11c898574 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:47.889545 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e6f27381-872c-4d23-8275-30e11c898574 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:47.889933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e6f27381-872c-4d23-8275-30e11c898574 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:47.890708 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e6f27381-872c-4d23-8275-30e11c898574 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:47.895689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e6f27381-872c-4d23-8275-30e11c898574 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:48.316389 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-00910797-3caf-4256-b70d-86a48f01a44a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:48.357719 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-00910797-3caf-4256-b70d-86a48f01a44a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1273 microversion: 2.1 time: 0.974055 Jul 20 22:45:48.360824 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 16/35] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:47 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1273 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:48.375385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-86d911a8-270c-4929-8044-a0808375e50e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:48.394026 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-86d911a8-270c-4929-8044-a0808375e50e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:48.416025 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e6f27381-872c-4d23-8275-30e11c898574 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:48.433645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e6f27381-872c-4d23-8275-30e11c898574 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1219 microversion: 2.1 time: 0.576315 Jul 20 22:45:48.434245 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 20/36] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:47 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1219 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:48.573709 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-86d911a8-270c-4929-8044-a0808375e50e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:48.584179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-86d911a8-270c-4929-8044-a0808375e50e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1237 microversion: 2.1 time: 0.214176 Jul 20 22:45:48.584900 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 17/37] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:48 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1237 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:48.682082 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-448835714", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b157aec-dd9e-48b2-9003-4eeafc1a43e4"}], "security_groups": [{"name": "tempest-securitygroup--2120653088"}], "key_name": "tempest-keypair-1442648441", "user_data": "}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:45:48.868046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ee5409de-6b0d-4e3e-a5fa-1bd2cf87d62b tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe2502a9550>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:49.032728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] validate_networks() for [('6b157aec-dd9e-48b2-9003-4eeafc1a43e4', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:45:49.585430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ee5409de-6b0d-4e3e-a5fa-1bd2cf87d62b tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 200 len: 353 microversion: 2.1 time: 0.720766 Jul 20 22:45:49.593285 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 18/38] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:48 2022] GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 353 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:49.601707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7fc3d4ac-eb75-4926-afd7-e1c1dd4afe89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:49.602608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7fc3d4ac-eb75-4926-afd7-e1c1dd4afe89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:49.629117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7fc3d4ac-eb75-4926-afd7-e1c1dd4afe89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:49.630499 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7fc3d4ac-eb75-4926-afd7-e1c1dd4afe89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:49.631364 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7fc3d4ac-eb75-4926-afd7-e1c1dd4afe89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:49.631821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7fc3d4ac-eb75-4926-afd7-e1c1dd4afe89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:49.815218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7fc3d4ac-eb75-4926-afd7-e1c1dd4afe89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:49.827037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7fc3d4ac-eb75-4926-afd7-e1c1dd4afe89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1279 microversion: 2.1 time: 0.231848 Jul 20 22:45:49.827615 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 19/39] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:49 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:49.839114 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8fda9d3a-3a14-4d3b-9411-bd9569ca60fa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:49.840992 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8fda9d3a-3a14-4d3b-9411-bd9569ca60fa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:49.850984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8fda9d3a-3a14-4d3b-9411-bd9569ca60fa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:49.852378 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8fda9d3a-3a14-4d3b-9411-bd9569ca60fa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:49.854487 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8fda9d3a-3a14-4d3b-9411-bd9569ca60fa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:49.855659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8fda9d3a-3a14-4d3b-9411-bd9569ca60fa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:49.966156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8fda9d3a-3a14-4d3b-9411-bd9569ca60fa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:49.975284 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8fda9d3a-3a14-4d3b-9411-bd9569ca60fa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1275 microversion: 2.1 time: 0.140179 Jul 20 22:45:49.976027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 20/40] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:49 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1275 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:49.986603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-38b7b786-f025-4d90-890c-c9722e2adbc4 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe2502be430>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:50.087139 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-38b7b786-f025-4d90-890c-c9722e2adbc4 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 200 len: 353 microversion: 2.1 time: 0.107236 Jul 20 22:45:50.087139 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 21/41] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:49 2022] GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:50.090404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-64e1b87d-5c7c-4baa-bc89-09da599cc9e4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:50.091039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-64e1b87d-5c7c-4baa-bc89-09da599cc9e4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:50.115102 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64e1b87d-5c7c-4baa-bc89-09da599cc9e4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:50.119397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64e1b87d-5c7c-4baa-bc89-09da599cc9e4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:50.125851 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64e1b87d-5c7c-4baa-bc89-09da599cc9e4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:50.125851 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64e1b87d-5c7c-4baa-bc89-09da599cc9e4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:50.237635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-64e1b87d-5c7c-4baa-bc89-09da599cc9e4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:50.260113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-64e1b87d-5c7c-4baa-bc89-09da599cc9e4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.173684 Jul 20 22:45:50.261004 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 22/42] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:50 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:50.266309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c4e664eb-c53d-4e81-85d4-1acb8c077b46 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe2502be9d0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:50.291248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:45:50.291820 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:45:50.292144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:45:50.292562 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:45:50.292983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:45:50.312489 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:50.519161 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:50.519161 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:50.519161 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:50.519161 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for project f733781536584f80acfc325bf8444536. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:45:50.520230 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for user 3e072e59bf3e46aaa062ec85b0e2c91a and project f733781536584f80acfc325bf8444536. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:45:50.520230 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:45:50.520230 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:45:50.867780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c4e664eb-c53d-4e81-85d4-1acb8c077b46 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 202 len: 0 microversion: 2.1 time: 0.605552 Jul 20 22:45:50.868374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 23/43] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:45:50 2022] DELETE /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:45:50.873832 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-22b44bed-e060-44c8-a9f4-36f6b4088e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:50.874514 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-22b44bed-e060-44c8-a9f4-36f6b4088e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:50.889326 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22b44bed-e060-44c8-a9f4-36f6b4088e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:50.891628 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22b44bed-e060-44c8-a9f4-36f6b4088e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:50.892680 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8c8a2f13-3812-485c-8534-28b938e113b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.215822 Jul 20 22:45:50.893630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22b44bed-e060-44c8-a9f4-36f6b4088e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:50.894372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 21/44] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:45:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:45:50.895208 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22b44bed-e060-44c8-a9f4-36f6b4088e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:50.917502 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0de9d2c0-4203-4d56-90bd-c70ec0177ecd tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe2502d18b0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:50.996873 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0de9d2c0-4203-4d56-90bd-c70ec0177ecd tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 200 len: 352 microversion: 2.1 time: 0.083781 Jul 20 22:45:50.997472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 22/45] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:50 2022] GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:51.006097 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9d867ed8-c0a1-4c37-be52-cadd196ad210 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:51.006711 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9d867ed8-c0a1-4c37-be52-cadd196ad210 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:51.085877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9d867ed8-c0a1-4c37-be52-cadd196ad210 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:51.092095 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9d867ed8-c0a1-4c37-be52-cadd196ad210 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1241 microversion: 2.1 time: 0.093275 Jul 20 22:45:51.092979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 23/46] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:50 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:51.105904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a7f4ad01-1cbc-4c03-a5e2-0569aec983d7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:51.106719 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a7f4ad01-1cbc-4c03-a5e2-0569aec983d7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:51.115289 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a7f4ad01-1cbc-4c03-a5e2-0569aec983d7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:51.115743 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a7f4ad01-1cbc-4c03-a5e2-0569aec983d7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:51.116529 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a7f4ad01-1cbc-4c03-a5e2-0569aec983d7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:51.117134 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a7f4ad01-1cbc-4c03-a5e2-0569aec983d7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:51.142856 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-22b44bed-e060-44c8-a9f4-36f6b4088e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:51.148465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-22b44bed-e060-44c8-a9f4-36f6b4088e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.278713 Jul 20 22:45:51.149236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 24/47] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:50 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:51.192704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a7f4ad01-1cbc-4c03-a5e2-0569aec983d7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:51.204104 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a7f4ad01-1cbc-4c03-a5e2-0569aec983d7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1285 microversion: 2.1 time: 0.109437 Jul 20 22:45:51.205154 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 24/48] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:51 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:51.291065 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1848cb57-bb5f-445a-86a0-aa310ef374cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:51.291877 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1848cb57-bb5f-445a-86a0-aa310ef374cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:51.301252 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1848cb57-bb5f-445a-86a0-aa310ef374cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:51.301943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1848cb57-bb5f-445a-86a0-aa310ef374cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:51.303581 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1848cb57-bb5f-445a-86a0-aa310ef374cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:51.304170 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1848cb57-bb5f-445a-86a0-aa310ef374cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:51.375903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1848cb57-bb5f-445a-86a0-aa310ef374cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:51.385311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1848cb57-bb5f-445a-86a0-aa310ef374cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.099677 Jul 20 22:45:51.395418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 25/49] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:51 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:52.009403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8260b8a8-267d-4cbd-a95b-c328715e31f0 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe2502e0700>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:52.064378 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8260b8a8-267d-4cbd-a95b-c328715e31f0 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 200 len: 352 microversion: 2.1 time: 0.051913 Jul 20 22:45:52.064378 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 25/50] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:52 2022] GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:52.109703 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8d75cfb5-84c5-4c2f-8d0a-1785ac7cb08b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:52.110617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8d75cfb5-84c5-4c2f-8d0a-1785ac7cb08b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:52.166457 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8cdccebc-7504-4f52-b2c7-14dbebfc8969 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:52.166558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8cdccebc-7504-4f52-b2c7-14dbebfc8969 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:52.168643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8d75cfb5-84c5-4c2f-8d0a-1785ac7cb08b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:52.173033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8cdccebc-7504-4f52-b2c7-14dbebfc8969 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:52.173488 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8cdccebc-7504-4f52-b2c7-14dbebfc8969 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:52.174246 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8cdccebc-7504-4f52-b2c7-14dbebfc8969 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:52.174683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8cdccebc-7504-4f52-b2c7-14dbebfc8969 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:52.175460 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8d75cfb5-84c5-4c2f-8d0a-1785ac7cb08b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1241 microversion: 2.1 time: 0.069738 Jul 20 22:45:52.176384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 26/51] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:52 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:52.221455 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b74257f5-f7f8-4f23-8b45-519fbda354b5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:52.222058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b74257f5-f7f8-4f23-8b45-519fbda354b5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:52.227970 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b74257f5-f7f8-4f23-8b45-519fbda354b5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:52.228416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b74257f5-f7f8-4f23-8b45-519fbda354b5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:52.229166 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b74257f5-f7f8-4f23-8b45-519fbda354b5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:52.229593 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b74257f5-f7f8-4f23-8b45-519fbda354b5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:52.300510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b74257f5-f7f8-4f23-8b45-519fbda354b5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:52.308268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b74257f5-f7f8-4f23-8b45-519fbda354b5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1285 microversion: 2.1 time: 0.091182 Jul 20 22:45:52.308844 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 27/52] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:52 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:52.347603 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8cdccebc-7504-4f52-b2c7-14dbebfc8969 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:52.355054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8cdccebc-7504-4f52-b2c7-14dbebfc8969 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.192935 Jul 20 22:45:52.355611 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 26/53] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:52 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:52.402389 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a38923fc-0f01-49aa-8188-a9f22bda689e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:52.402939 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a38923fc-0f01-49aa-8188-a9f22bda689e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:52.409981 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a38923fc-0f01-49aa-8188-a9f22bda689e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:52.413383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a38923fc-0f01-49aa-8188-a9f22bda689e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:52.413383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a38923fc-0f01-49aa-8188-a9f22bda689e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:52.413383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a38923fc-0f01-49aa-8188-a9f22bda689e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:52.479423 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a38923fc-0f01-49aa-8188-a9f22bda689e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:52.487933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a38923fc-0f01-49aa-8188-a9f22bda689e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.089105 Jul 20 22:45:52.488510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 28/54] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:52 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:53.070797 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8c3d3b8b-236b-45f6-8c5f-5cc9d606b285 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe2502e0040>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:53.117541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8c3d3b8b-236b-45f6-8c5f-5cc9d606b285 tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 200 len: 352 microversion: 2.1 time: 0.050457 Jul 20 22:45:53.118116 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 27/55] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:53 2022] GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:53.193324 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-63bebad3-946e-44a8-bd1a-581ba26f5575 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:53.193878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-63bebad3-946e-44a8-bd1a-581ba26f5575 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:53.196918 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:53.200370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-63bebad3-946e-44a8-bd1a-581ba26f5575 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:53.200816 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-63bebad3-946e-44a8-bd1a-581ba26f5575 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:53.201579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-63bebad3-946e-44a8-bd1a-581ba26f5575 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:53.202022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-63bebad3-946e-44a8-bd1a-581ba26f5575 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:53.262331 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-63bebad3-946e-44a8-bd1a-581ba26f5575 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:53.269641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-63bebad3-946e-44a8-bd1a-581ba26f5575 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.080343 Jul 20 22:45:53.270202 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 29/56] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:53 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:53.325424 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-613e804c-06c0-44a0-8e0b-830873fc4aff tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:53.326213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-613e804c-06c0-44a0-8e0b-830873fc4aff tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:53.332058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-613e804c-06c0-44a0-8e0b-830873fc4aff tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:53.332582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-613e804c-06c0-44a0-8e0b-830873fc4aff tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:53.333259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-613e804c-06c0-44a0-8e0b-830873fc4aff tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:53.333695 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-613e804c-06c0-44a0-8e0b-830873fc4aff tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:53.371841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-77851cbe-70ba-4528-aec1-a05bb54b366e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:53.372453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-77851cbe-70ba-4528-aec1-a05bb54b366e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:53.378731 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-77851cbe-70ba-4528-aec1-a05bb54b366e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:53.379220 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-77851cbe-70ba-4528-aec1-a05bb54b366e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:53.380009 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-77851cbe-70ba-4528-aec1-a05bb54b366e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:53.380442 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-77851cbe-70ba-4528-aec1-a05bb54b366e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:53.397026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-613e804c-06c0-44a0-8e0b-830873fc4aff tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:53.404484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-613e804c-06c0-44a0-8e0b-830873fc4aff tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1273 microversion: 2.1 time: 0.083317 Jul 20 22:45:53.405062 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 28/57] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:53 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:53.507033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a36c380a-a82a-4287-a2a3-6f04d045b08a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:53.507727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a36c380a-a82a-4287-a2a3-6f04d045b08a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:53.513088 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-77851cbe-70ba-4528-aec1-a05bb54b366e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:53.513888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a36c380a-a82a-4287-a2a3-6f04d045b08a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:53.514538 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a36c380a-a82a-4287-a2a3-6f04d045b08a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:53.515915 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a36c380a-a82a-4287-a2a3-6f04d045b08a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:53.516745 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a36c380a-a82a-4287-a2a3-6f04d045b08a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:53.542260 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-77851cbe-70ba-4528-aec1-a05bb54b366e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.174037 Jul 20 22:45:53.542844 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 30/58] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:53 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:53.608233 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a36c380a-a82a-4287-a2a3-6f04d045b08a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:53.619564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a36c380a-a82a-4287-a2a3-6f04d045b08a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.118062 Jul 20 22:45:53.620589 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 29/59] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:53 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:54.131633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-099c3e65-b5b9-495e-985f-3624caad610a tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe2502a9040>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:54.220700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-099c3e65-b5b9-495e-985f-3624caad610a tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 200 len: 352 microversion: 2.1 time: 0.094071 Jul 20 22:45:54.226428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 31/60] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:54 2022] GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:45:54.287233 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-32513948-9cff-4b7e-90ff-6184303325db tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:54.288445 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-32513948-9cff-4b7e-90ff-6184303325db tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:54.295809 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-32513948-9cff-4b7e-90ff-6184303325db tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:54.296260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-32513948-9cff-4b7e-90ff-6184303325db tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:54.297653 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-32513948-9cff-4b7e-90ff-6184303325db tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:54.298090 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-32513948-9cff-4b7e-90ff-6184303325db tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:54.371364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-32513948-9cff-4b7e-90ff-6184303325db tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:54.380941 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-32513948-9cff-4b7e-90ff-6184303325db tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.097206 Jul 20 22:45:54.381890 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 30/61] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:54 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:54.423725 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-91237501-c845-4ae3-a05d-38bf47212514 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:54.424426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-91237501-c845-4ae3-a05d-38bf47212514 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:54.430598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91237501-c845-4ae3-a05d-38bf47212514 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:54.435427 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91237501-c845-4ae3-a05d-38bf47212514 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:54.435427 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91237501-c845-4ae3-a05d-38bf47212514 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:54.435427 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91237501-c845-4ae3-a05d-38bf47212514 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:54.514104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-91237501-c845-4ae3-a05d-38bf47212514 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:54.522899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-91237501-c845-4ae3-a05d-38bf47212514 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1273 microversion: 2.1 time: 0.103400 Jul 20 22:45:54.523530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 32/62] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:54 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:54.560119 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cc0b41e2-6dab-4b26-9c40-dd0b0c287377 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:54.560853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cc0b41e2-6dab-4b26-9c40-dd0b0c287377 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:54.569064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc0b41e2-6dab-4b26-9c40-dd0b0c287377 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:54.569664 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc0b41e2-6dab-4b26-9c40-dd0b0c287377 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:54.574811 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc0b41e2-6dab-4b26-9c40-dd0b0c287377 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:54.574811 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc0b41e2-6dab-4b26-9c40-dd0b0c287377 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:54.640851 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fb0e17fc-7a4e-4f8a-b661-1573a6c96bda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:54.642342 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fb0e17fc-7a4e-4f8a-b661-1573a6c96bda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:54.654999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb0e17fc-7a4e-4f8a-b661-1573a6c96bda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:54.658851 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb0e17fc-7a4e-4f8a-b661-1573a6c96bda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:54.661433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb0e17fc-7a4e-4f8a-b661-1573a6c96bda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:54.663585 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb0e17fc-7a4e-4f8a-b661-1573a6c96bda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:54.764615 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fb0e17fc-7a4e-4f8a-b661-1573a6c96bda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:54.770998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fb0e17fc-7a4e-4f8a-b661-1573a6c96bda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.137611 Jul 20 22:45:54.785353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 33/63] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:54 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:54.789374 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cc0b41e2-6dab-4b26-9c40-dd0b0c287377 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:54.797588 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cc0b41e2-6dab-4b26-9c40-dd0b0c287377 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.241472 Jul 20 22:45:54.802722 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 31/64] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:54 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:55.233487 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5642febd-eee3-41c7-b9ab-7e48c51c959c tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Calling method '.version_select at 0x7fe250380670>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:55.398250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ecf453fe-d234-441f-9082-02a0534cf131 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:55.399965 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ecf453fe-d234-441f-9082-02a0534cf131 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:55.410451 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ecf453fe-d234-441f-9082-02a0534cf131 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:55.411418 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ecf453fe-d234-441f-9082-02a0534cf131 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:55.412409 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ecf453fe-d234-441f-9082-02a0534cf131 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:55.412957 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ecf453fe-d234-441f-9082-02a0534cf131 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:55.490932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ecf453fe-d234-441f-9082-02a0534cf131 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:55.499650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ecf453fe-d234-441f-9082-02a0534cf131 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.105717 Jul 20 22:45:55.501100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 32/65] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:55 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:55.541020 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-17a17d0d-9139-4300-ae15-600c6ac7523c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:55.541798 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-17a17d0d-9139-4300-ae15-600c6ac7523c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:55.549440 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-17a17d0d-9139-4300-ae15-600c6ac7523c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:55.550179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-17a17d0d-9139-4300-ae15-600c6ac7523c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:55.551331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-17a17d0d-9139-4300-ae15-600c6ac7523c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:55.551942 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-17a17d0d-9139-4300-ae15-600c6ac7523c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:55.627259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-17a17d0d-9139-4300-ae15-600c6ac7523c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:55.637813 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-17a17d0d-9139-4300-ae15-600c6ac7523c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1273 microversion: 2.1 time: 0.100860 Jul 20 22:45:55.638407 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 33/66] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:55 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:55.786899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-5642febd-eee3-41c7-b9ab-7e48c51c959c tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] HTTP exception thrown: Volume 460ec296-2725-4aca-89e5-e1e45efde1eb could not be found. Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5642febd-eee3-41c7-b9ab-7e48c51c959c tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Request method failure captured: Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb HTTP/1.1 Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWYFeUE2g1MzKhAIWFyUCRxPvbX60L3J990C__4DIhxoVtzcj8MvHBb-VYU0c7XgThIkKMEkxXx1IqrVQxEpu92rJkXNtVPrA-DIjqaMwVmFTdzbnqtpdR1mRx1_vYi08Qj7GsIUxRGyk-wGa4vx9-u08E4-UpYuWYUpApeOzpK2t4 Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 22824ce78e8a4fc79f8394e536768ab3 Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesGetTestJSON-954079614 Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:45:55.791370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_22824ce78e8a4fc79f8394e536768ab3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/22824ce78e8a4fc79f8394e536768ab3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/22824ce78e8a4fc79f8394e536768ab3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/22824ce78e8a4fc79f8394e536768ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesGetTestJSON-954079614 Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 22824ce78e8a4fc79f8394e536768ab3 Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesGetTestJSON-954079614 Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesGetTestJSON-954079614-project Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 531e1e88ccf94f91a058f7b1334836a6 Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesGetTestJSON-954079614-project Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Volume 460ec296-2725-4aca-89e5-e1e45efde1eb could not be found. Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '460ec296-2725-4aca-89e5-e1e45efde1eb'} Jul 20 22:45:55.792612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 460ec296-2725-4aca-89e5-e1e45efde1eb could not be found. (HTTP 404) (Request-ID: req-350216e7-5351-43af-a46d-5640c1e89392) Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:55.793307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:45:55.794368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 460ec296-2725-4aca-89e5-e1e45efde1eb could not be found. Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 22:45:55.795357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 460ec296-2725-4aca-89e5-e1e45efde1eb could not be found. Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 460ec296-2725-4aca-89e5-e1e45efde1eb could not be found. Jul 20 22:45:55.800265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:45:55.801558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8929683d-02d4-4125-a9fb-17bab0379a6d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:55.801558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8929683d-02d4-4125-a9fb-17bab0379a6d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:55.802845 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5642febd-eee3-41c7-b9ab-7e48c51c959c tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] Returning 404 to user: Volume 460ec296-2725-4aca-89e5-e1e45efde1eb could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:45:55.803742 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8929683d-02d4-4125-a9fb-17bab0379a6d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:55.803862 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5642febd-eee3-41c7-b9ab-7e48c51c959c tempest-VolumesGetTestJSON-954079614 tempest-VolumesGetTestJSON-954079614-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb" status: 404 len: 109 microversion: 2.1 time: 0.574474 Jul 20 22:45:55.804250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8929683d-02d4-4125-a9fb-17bab0379a6d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:55.808783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 34/67] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:45:55 2022] GET /compute/v2.1/os-volumes/460ec296-2725-4aca-89e5-e1e45efde1eb => generated 109 bytes in 576 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:45:55.810668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8929683d-02d4-4125-a9fb-17bab0379a6d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:55.815427 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8929683d-02d4-4125-a9fb-17bab0379a6d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:55.846702 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a12de9fa-04bf-4565-99ce-8e1986137224 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:55.853518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a12de9fa-04bf-4565-99ce-8e1986137224 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:55.880051 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a12de9fa-04bf-4565-99ce-8e1986137224 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:55.881174 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a12de9fa-04bf-4565-99ce-8e1986137224 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:55.882184 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a12de9fa-04bf-4565-99ce-8e1986137224 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:55.882824 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a12de9fa-04bf-4565-99ce-8e1986137224 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:55.968052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8929683d-02d4-4125-a9fb-17bab0379a6d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:55.977778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8929683d-02d4-4125-a9fb-17bab0379a6d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.188854 Jul 20 22:45:55.983050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 34/68] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:55 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:56.146879 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a12de9fa-04bf-4565-99ce-8e1986137224 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:56.154100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=6 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:56.157683 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a12de9fa-04bf-4565-99ce-8e1986137224 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.341267 Jul 20 22:45:56.159043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 35/69] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:55 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:56.519900 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-382837db-3b08-4eec-83ac-b1ee6bb935e4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:56.522716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-382837db-3b08-4eec-83ac-b1ee6bb935e4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:56.536252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-382837db-3b08-4eec-83ac-b1ee6bb935e4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:56.542403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-382837db-3b08-4eec-83ac-b1ee6bb935e4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:56.542403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-382837db-3b08-4eec-83ac-b1ee6bb935e4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:56.542403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-382837db-3b08-4eec-83ac-b1ee6bb935e4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:56.639640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-382837db-3b08-4eec-83ac-b1ee6bb935e4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:56.648454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-382837db-3b08-4eec-83ac-b1ee6bb935e4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.134957 Jul 20 22:45:56.649428 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 35/70] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:56 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:56.664754 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6fd72ac2-e46d-4ff8-9857-f73e0648b2c4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:56.665424 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6fd72ac2-e46d-4ff8-9857-f73e0648b2c4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:56.677310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6fd72ac2-e46d-4ff8-9857-f73e0648b2c4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:56.677931 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6fd72ac2-e46d-4ff8-9857-f73e0648b2c4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:56.679400 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6fd72ac2-e46d-4ff8-9857-f73e0648b2c4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:56.680076 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6fd72ac2-e46d-4ff8-9857-f73e0648b2c4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:56.802843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6fd72ac2-e46d-4ff8-9857-f73e0648b2c4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:56.811454 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6fd72ac2-e46d-4ff8-9857-f73e0648b2c4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1273 microversion: 2.1 time: 0.150333 Jul 20 22:45:56.815141 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 36/71] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:56 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:56.995339 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-11a0c39c-6a04-4a14-89be-5a8f2fa05682 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:56.996183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-11a0c39c-6a04-4a14-89be-5a8f2fa05682 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:57.014050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-11a0c39c-6a04-4a14-89be-5a8f2fa05682 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:57.014919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-11a0c39c-6a04-4a14-89be-5a8f2fa05682 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:57.015296 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-11a0c39c-6a04-4a14-89be-5a8f2fa05682 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:57.021541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-11a0c39c-6a04-4a14-89be-5a8f2fa05682 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:57.143583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-11a0c39c-6a04-4a14-89be-5a8f2fa05682 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:57.155914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-11a0c39c-6a04-4a14-89be-5a8f2fa05682 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.164359 Jul 20 22:45:57.157233 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 36/72] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:56 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:57.177545 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f24d0a2d-77b6-416f-8746-e0f3c0b3a35e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:57.179348 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f24d0a2d-77b6-416f-8746-e0f3c0b3a35e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:57.203658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f24d0a2d-77b6-416f-8746-e0f3c0b3a35e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:57.203895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f24d0a2d-77b6-416f-8746-e0f3c0b3a35e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:57.205385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f24d0a2d-77b6-416f-8746-e0f3c0b3a35e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:57.205821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f24d0a2d-77b6-416f-8746-e0f3c0b3a35e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:57.455890 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f24d0a2d-77b6-416f-8746-e0f3c0b3a35e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:57.463837 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f24d0a2d-77b6-416f-8746-e0f3c0b3a35e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.292623 Jul 20 22:45:57.475001 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 37/73] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:57 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:57.666379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7ec281f6-4a87-41f5-bc21-76458305450c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:57.670383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7ec281f6-4a87-41f5-bc21-76458305450c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:57.694958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7ec281f6-4a87-41f5-bc21-76458305450c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:57.699100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7ec281f6-4a87-41f5-bc21-76458305450c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:57.699100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7ec281f6-4a87-41f5-bc21-76458305450c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:57.699100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7ec281f6-4a87-41f5-bc21-76458305450c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:57.830331 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-91dd3868-1162-416a-adca-b030b6a920c2 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:57.831037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-91dd3868-1162-416a-adca-b030b6a920c2 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:57.832027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7ec281f6-4a87-41f5-bc21-76458305450c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:57.840252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7ec281f6-4a87-41f5-bc21-76458305450c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.177657 Jul 20 22:45:57.847039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91dd3868-1162-416a-adca-b030b6a920c2 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:57.849894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91dd3868-1162-416a-adca-b030b6a920c2 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:57.851637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 37/74] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:57 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:57.852070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91dd3868-1162-416a-adca-b030b6a920c2 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:57.854310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91dd3868-1162-416a-adca-b030b6a920c2 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:57.883982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:57.969599 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-91dd3868-1162-416a-adca-b030b6a920c2 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:57.979556 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-91dd3868-1162-416a-adca-b030b6a920c2 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1273 microversion: 2.1 time: 0.154816 Jul 20 22:45:57.996115 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 38/75] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:57 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:58.174095 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ac0172c1-973a-405a-b379-3ee4049b3d31 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:58.174705 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ac0172c1-973a-405a-b379-3ee4049b3d31 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:58.183549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ac0172c1-973a-405a-b379-3ee4049b3d31 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:58.183549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ac0172c1-973a-405a-b379-3ee4049b3d31 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:58.183549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ac0172c1-973a-405a-b379-3ee4049b3d31 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:58.183549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ac0172c1-973a-405a-b379-3ee4049b3d31 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:58.251716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ac0172c1-973a-405a-b379-3ee4049b3d31 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:58.260462 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ac0172c1-973a-405a-b379-3ee4049b3d31 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.090549 Jul 20 22:45:58.268997 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 38/76] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:58 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:58.481692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1ec2fcf9-f2e2-4762-8a16-43b905798114 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:58.482305 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1ec2fcf9-f2e2-4762-8a16-43b905798114 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:58.492022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1ec2fcf9-f2e2-4762-8a16-43b905798114 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:58.494899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1ec2fcf9-f2e2-4762-8a16-43b905798114 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:58.494899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1ec2fcf9-f2e2-4762-8a16-43b905798114 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:58.494899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1ec2fcf9-f2e2-4762-8a16-43b905798114 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:58.698105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1ec2fcf9-f2e2-4762-8a16-43b905798114 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:58.707923 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1ec2fcf9-f2e2-4762-8a16-43b905798114 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.230427 Jul 20 22:45:58.709158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 39/77] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:58 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:58.858236 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-145d0d10-9b85-4080-b8cc-16edf1edb40c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:58.858929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-145d0d10-9b85-4080-b8cc-16edf1edb40c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:58.865412 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-145d0d10-9b85-4080-b8cc-16edf1edb40c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:58.865888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-145d0d10-9b85-4080-b8cc-16edf1edb40c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:58.866678 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-145d0d10-9b85-4080-b8cc-16edf1edb40c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:58.867225 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-145d0d10-9b85-4080-b8cc-16edf1edb40c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:58.961343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-145d0d10-9b85-4080-b8cc-16edf1edb40c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:58.973124 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-145d0d10-9b85-4080-b8cc-16edf1edb40c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.118741 Jul 20 22:45:58.973706 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 39/78] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:58 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:59.014920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-53505c68-b4dd-48d2-b139-9417d47a7283 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:59.018595 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-53505c68-b4dd-48d2-b139-9417d47a7283 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:59.028082 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53505c68-b4dd-48d2-b139-9417d47a7283 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:59.028859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53505c68-b4dd-48d2-b139-9417d47a7283 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:59.029714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53505c68-b4dd-48d2-b139-9417d47a7283 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:59.030211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53505c68-b4dd-48d2-b139-9417d47a7283 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:59.099485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-53505c68-b4dd-48d2-b139-9417d47a7283 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:59.108344 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-53505c68-b4dd-48d2-b139-9417d47a7283 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1273 microversion: 2.1 time: 0.099621 Jul 20 22:45:59.110373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 40/79] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:59 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:45:59.286109 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7e4fa804-f9b3-42b0-b701-cc733f1be1ed tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:59.286867 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7e4fa804-f9b3-42b0-b701-cc733f1be1ed tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:59.295132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e4fa804-f9b3-42b0-b701-cc733f1be1ed tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:59.295390 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e4fa804-f9b3-42b0-b701-cc733f1be1ed tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:59.300645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e4fa804-f9b3-42b0-b701-cc733f1be1ed tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:59.301152 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e4fa804-f9b3-42b0-b701-cc733f1be1ed tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:59.416511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7e4fa804-f9b3-42b0-b701-cc733f1be1ed tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:45:59.420266 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:59.429146 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7e4fa804-f9b3-42b0-b701-cc733f1be1ed tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.148352 Jul 20 22:45:59.429752 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 40/80] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:59 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:45:59.726023 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-97d596cd-9b77-460f-9b92-b6409ccde2e2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:59.726787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-97d596cd-9b77-460f-9b92-b6409ccde2e2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:59.748800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97d596cd-9b77-460f-9b92-b6409ccde2e2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:59.750135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97d596cd-9b77-460f-9b92-b6409ccde2e2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:59.756803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97d596cd-9b77-460f-9b92-b6409ccde2e2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:45:59.757452 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97d596cd-9b77-460f-9b92-b6409ccde2e2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:45:59.991561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-15d7c560-ac65-49ea-a047-7a2dc5b8b96b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:45:59.992148 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-15d7c560-ac65-49ea-a047-7a2dc5b8b96b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:45:59.997035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-97d596cd-9b77-460f-9b92-b6409ccde2e2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:00.006647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-15d7c560-ac65-49ea-a047-7a2dc5b8b96b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:00.006850 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-97d596cd-9b77-460f-9b92-b6409ccde2e2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.284694 Jul 20 22:46:00.007145 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-15d7c560-ac65-49ea-a047-7a2dc5b8b96b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:00.007936 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 41/81] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:59 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:00.011602 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-15d7c560-ac65-49ea-a047-7a2dc5b8b96b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:00.012208 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-15d7c560-ac65-49ea-a047-7a2dc5b8b96b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:00.090448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-15d7c560-ac65-49ea-a047-7a2dc5b8b96b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:00.099820 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-15d7c560-ac65-49ea-a047-7a2dc5b8b96b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.112124 Jul 20 22:46:00.100932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 41/82] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:45:59 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:00.137372 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7288d572-ba24-4753-ba04-a87f7fd255eb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:00.137372 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7288d572-ba24-4753-ba04-a87f7fd255eb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:00.137372 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7288d572-ba24-4753-ba04-a87f7fd255eb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:00.137372 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7288d572-ba24-4753-ba04-a87f7fd255eb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:00.138124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7288d572-ba24-4753-ba04-a87f7fd255eb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:00.138124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7288d572-ba24-4753-ba04-a87f7fd255eb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:00.247062 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7288d572-ba24-4753-ba04-a87f7fd255eb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:00.258436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7288d572-ba24-4753-ba04-a87f7fd255eb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1273 microversion: 2.1 time: 0.134734 Jul 20 22:46:00.269279 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 42/83] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:00 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:00.447229 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fd4b5f7f-2d46-4048-9ab8-a4c51ed8d508 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:00.447841 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fd4b5f7f-2d46-4048-9ab8-a4c51ed8d508 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:00.449762 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=4 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:00.454745 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fd4b5f7f-2d46-4048-9ab8-a4c51ed8d508 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:00.455211 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fd4b5f7f-2d46-4048-9ab8-a4c51ed8d508 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:00.456023 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fd4b5f7f-2d46-4048-9ab8-a4c51ed8d508 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:00.456453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fd4b5f7f-2d46-4048-9ab8-a4c51ed8d508 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:00.531033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fd4b5f7f-2d46-4048-9ab8-a4c51ed8d508 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:00.548327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fd4b5f7f-2d46-4048-9ab8-a4c51ed8d508 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1289 microversion: 2.1 time: 0.104955 Jul 20 22:46:00.549391 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 42/84] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:00 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:01.023080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-510bcea7-b402-44ce-8a71-e5ee8d088592 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:01.023690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-510bcea7-b402-44ce-8a71-e5ee8d088592 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:01.029901 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-510bcea7-b402-44ce-8a71-e5ee8d088592 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:01.030345 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-510bcea7-b402-44ce-8a71-e5ee8d088592 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:01.031683 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-510bcea7-b402-44ce-8a71-e5ee8d088592 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:01.032113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-510bcea7-b402-44ce-8a71-e5ee8d088592 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:01.117363 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-80628331-374d-4025-a232-c8e7374f5de9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:01.124955 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-80628331-374d-4025-a232-c8e7374f5de9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:01.129497 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=20 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:01.131864 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80628331-374d-4025-a232-c8e7374f5de9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:01.134368 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80628331-374d-4025-a232-c8e7374f5de9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:01.135395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80628331-374d-4025-a232-c8e7374f5de9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:01.135977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80628331-374d-4025-a232-c8e7374f5de9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:01.276674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-80628331-374d-4025-a232-c8e7374f5de9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:01.286335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-80628331-374d-4025-a232-c8e7374f5de9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.173076 Jul 20 22:46:01.287359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 43/85] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:01 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:01.294047 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c9bae0cd-1eb4-478a-875e-d70f48704b69 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:01.296359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c9bae0cd-1eb4-478a-875e-d70f48704b69 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:01.301760 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9bae0cd-1eb4-478a-875e-d70f48704b69 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:01.302423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9bae0cd-1eb4-478a-875e-d70f48704b69 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:01.303538 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9bae0cd-1eb4-478a-875e-d70f48704b69 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:01.304039 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9bae0cd-1eb4-478a-875e-d70f48704b69 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:01.381582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c9bae0cd-1eb4-478a-875e-d70f48704b69 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:01.389916 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c9bae0cd-1eb4-478a-875e-d70f48704b69 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1273 microversion: 2.1 time: 0.101286 Jul 20 22:46:01.394893 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 44/86] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:01 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:01.469824 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-510bcea7-b402-44ce-8a71-e5ee8d088592 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:01.481506 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-510bcea7-b402-44ce-8a71-e5ee8d088592 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.461410 Jul 20 22:46:01.483107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 43/87] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:01 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:01.565616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f84d5750-c20a-431a-bbea-77bdd0caab07 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:01.566228 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f84d5750-c20a-431a-bbea-77bdd0caab07 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:01.572392 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f84d5750-c20a-431a-bbea-77bdd0caab07 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:01.573038 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f84d5750-c20a-431a-bbea-77bdd0caab07 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:01.573818 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f84d5750-c20a-431a-bbea-77bdd0caab07 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:01.574248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f84d5750-c20a-431a-bbea-77bdd0caab07 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:01.655056 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f84d5750-c20a-431a-bbea-77bdd0caab07 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:01.667294 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f84d5750-c20a-431a-bbea-77bdd0caab07 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1297 microversion: 2.1 time: 0.103469 Jul 20 22:46:01.679175 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 45/88] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:01 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1297 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:02.304537 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5e1c41b7-0ba1-4eb3-a99d-a15773d078c4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:02.305365 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5e1c41b7-0ba1-4eb3-a99d-a15773d078c4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:02.307476 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=32 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:02.312504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5e1c41b7-0ba1-4eb3-a99d-a15773d078c4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:02.313153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5e1c41b7-0ba1-4eb3-a99d-a15773d078c4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:02.313914 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5e1c41b7-0ba1-4eb3-a99d-a15773d078c4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:02.314347 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5e1c41b7-0ba1-4eb3-a99d-a15773d078c4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:02.407811 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c024a9e5-d690-45e7-a0eb-e78cd009067e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:02.408418 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c024a9e5-d690-45e7-a0eb-e78cd009067e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:02.412791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:02.418249 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c024a9e5-d690-45e7-a0eb-e78cd009067e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:02.418944 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c024a9e5-d690-45e7-a0eb-e78cd009067e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:02.419938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c024a9e5-d690-45e7-a0eb-e78cd009067e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:02.420473 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c024a9e5-d690-45e7-a0eb-e78cd009067e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:02.443873 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5e1c41b7-0ba1-4eb3-a99d-a15773d078c4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:02.466761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5e1c41b7-0ba1-4eb3-a99d-a15773d078c4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1245 microversion: 2.1 time: 0.165349 Jul 20 22:46:02.470223 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 44/89] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:02 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:02.500289 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4137a22a-0190-44aa-bb14-ebe92d6879cb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:02.501141 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4137a22a-0190-44aa-bb14-ebe92d6879cb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:02.512253 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4137a22a-0190-44aa-bb14-ebe92d6879cb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:02.512899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4137a22a-0190-44aa-bb14-ebe92d6879cb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:02.513789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4137a22a-0190-44aa-bb14-ebe92d6879cb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:02.514310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4137a22a-0190-44aa-bb14-ebe92d6879cb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:02.592079 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c024a9e5-d690-45e7-a0eb-e78cd009067e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:02.600123 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c024a9e5-d690-45e7-a0eb-e78cd009067e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.196703 Jul 20 22:46:02.602848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 46/90] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:02 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:02.689424 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8410c4c1-b460-4d23-84f2-b4ef45952d34 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:02.690856 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8410c4c1-b460-4d23-84f2-b4ef45952d34 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:02.697914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8410c4c1-b460-4d23-84f2-b4ef45952d34 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:02.699174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8410c4c1-b460-4d23-84f2-b4ef45952d34 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:02.700390 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8410c4c1-b460-4d23-84f2-b4ef45952d34 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:02.701004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8410c4c1-b460-4d23-84f2-b4ef45952d34 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:02.774046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4137a22a-0190-44aa-bb14-ebe92d6879cb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:02.783103 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4137a22a-0190-44aa-bb14-ebe92d6879cb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.286574 Jul 20 22:46:02.785292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 45/91] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:02 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:02.803748 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8410c4c1-b460-4d23-84f2-b4ef45952d34 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:02.811609 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8410c4c1-b460-4d23-84f2-b4ef45952d34 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1297 microversion: 2.1 time: 0.128760 Jul 20 22:46:02.812291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 47/92] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:02 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:03.493593 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f1b7e345-353f-4f7d-8c99-409e8968607f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:03.493593 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f1b7e345-353f-4f7d-8c99-409e8968607f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:03.506137 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f1b7e345-353f-4f7d-8c99-409e8968607f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:03.506867 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f1b7e345-353f-4f7d-8c99-409e8968607f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:03.508659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f1b7e345-353f-4f7d-8c99-409e8968607f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:03.509884 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f1b7e345-353f-4f7d-8c99-409e8968607f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:03.617389 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1024d37e-ef71-42a4-b64f-94705ae826d5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:03.620206 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1024d37e-ef71-42a4-b64f-94705ae826d5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:03.631180 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1024d37e-ef71-42a4-b64f-94705ae826d5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:03.631860 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1024d37e-ef71-42a4-b64f-94705ae826d5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:03.632817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1024d37e-ef71-42a4-b64f-94705ae826d5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:03.633577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1024d37e-ef71-42a4-b64f-94705ae826d5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:03.696093 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f1b7e345-353f-4f7d-8c99-409e8968607f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:03.704341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f1b7e345-353f-4f7d-8c99-409e8968607f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1237 microversion: 2.1 time: 0.217011 Jul 20 22:46:03.724149 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 46/93] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:03 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1237 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:03.806118 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-eec8385d-ca09-42a2-b36c-f1895f41bdd6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:03.807179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-eec8385d-ca09-42a2-b36c-f1895f41bdd6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:03.822575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eec8385d-ca09-42a2-b36c-f1895f41bdd6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:03.823536 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eec8385d-ca09-42a2-b36c-f1895f41bdd6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:03.826432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eec8385d-ca09-42a2-b36c-f1895f41bdd6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:03.826980 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eec8385d-ca09-42a2-b36c-f1895f41bdd6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:04.132242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-eec8385d-ca09-42a2-b36c-f1895f41bdd6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:04.139322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-eec8385d-ca09-42a2-b36c-f1895f41bdd6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.339937 Jul 20 22:46:04.143937 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 47/94] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:03 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:04.155660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3f226560-b50d-4eb7-a9bd-24a845c8965e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:04.161151 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3f226560-b50d-4eb7-a9bd-24a845c8965e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:04.161455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1024d37e-ef71-42a4-b64f-94705ae826d5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:04.168731 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3f226560-b50d-4eb7-a9bd-24a845c8965e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:04.169447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3f226560-b50d-4eb7-a9bd-24a845c8965e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:04.170417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3f226560-b50d-4eb7-a9bd-24a845c8965e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:04.170998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3f226560-b50d-4eb7-a9bd-24a845c8965e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:04.172692 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1024d37e-ef71-42a4-b64f-94705ae826d5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.558697 Jul 20 22:46:04.178073 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 48/95] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:03 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:04.293593 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3f226560-b50d-4eb7-a9bd-24a845c8965e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:04.304272 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3f226560-b50d-4eb7-a9bd-24a845c8965e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1295 microversion: 2.1 time: 0.156254 Jul 20 22:46:04.304272 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 48/96] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:04 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1295 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:04.721829 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ab10f355-1229-44b0-8fb8-18983ca2c699 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:04.722970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ab10f355-1229-44b0-8fb8-18983ca2c699 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:04.732967 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ab10f355-1229-44b0-8fb8-18983ca2c699 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:04.733671 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ab10f355-1229-44b0-8fb8-18983ca2c699 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:04.734827 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ab10f355-1229-44b0-8fb8-18983ca2c699 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:04.736237 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ab10f355-1229-44b0-8fb8-18983ca2c699 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:04.890761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ab10f355-1229-44b0-8fb8-18983ca2c699 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:04.908070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ab10f355-1229-44b0-8fb8-18983ca2c699 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1301 microversion: 2.1 time: 0.187238 Jul 20 22:46:04.908070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 49/97] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:04 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1301 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:05.160077 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7136ae63-4d16-42c8-a835-b1ad646249aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:05.160652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7136ae63-4d16-42c8-a835-b1ad646249aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:05.181799 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7136ae63-4d16-42c8-a835-b1ad646249aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:05.182441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7136ae63-4d16-42c8-a835-b1ad646249aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:05.183468 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7136ae63-4d16-42c8-a835-b1ad646249aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:05.185048 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7136ae63-4d16-42c8-a835-b1ad646249aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:05.192761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-124490b7-508a-4e6e-9222-598b7462568e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:05.193623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-124490b7-508a-4e6e-9222-598b7462568e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:05.206654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-124490b7-508a-4e6e-9222-598b7462568e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:05.207086 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-124490b7-508a-4e6e-9222-598b7462568e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:05.207871 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-124490b7-508a-4e6e-9222-598b7462568e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:05.208307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-124490b7-508a-4e6e-9222-598b7462568e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:05.585595 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-124490b7-508a-4e6e-9222-598b7462568e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:05.599044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-124490b7-508a-4e6e-9222-598b7462568e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.410174 Jul 20 22:46:05.600736 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 50/98] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:05 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:05.623793 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4cb61c71-0c94-4d11-8330-a5084d1dcbb9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:05.628485 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4cb61c71-0c94-4d11-8330-a5084d1dcbb9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:05.645960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4cb61c71-0c94-4d11-8330-a5084d1dcbb9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:05.647826 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4cb61c71-0c94-4d11-8330-a5084d1dcbb9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:05.649170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4cb61c71-0c94-4d11-8330-a5084d1dcbb9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:05.649924 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4cb61c71-0c94-4d11-8330-a5084d1dcbb9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:06.011568 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7136ae63-4d16-42c8-a835-b1ad646249aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:06.011568 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7136ae63-4d16-42c8-a835-b1ad646249aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.849877 Jul 20 22:46:06.011568 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 49/99] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:05 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:06.185671 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4cb61c71-0c94-4d11-8330-a5084d1dcbb9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:06.189543 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4cb61c71-0c94-4d11-8330-a5084d1dcbb9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.584323 Jul 20 22:46:06.200028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 51/100] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:05 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:06.200028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-12afb8ab-54c0-4a77-9af9-1c8eae4165c2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:06.200028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-12afb8ab-54c0-4a77-9af9-1c8eae4165c2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:06.210418 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-12afb8ab-54c0-4a77-9af9-1c8eae4165c2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:06.210968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-12afb8ab-54c0-4a77-9af9-1c8eae4165c2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:06.212223 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-12afb8ab-54c0-4a77-9af9-1c8eae4165c2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:06.212595 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-12afb8ab-54c0-4a77-9af9-1c8eae4165c2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:06.323750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-9c568e39-fafe-4cf3-ad70-72fe4a45dadf req-d75c2ee9-cbf4-4394-813b-ee5028a9b796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd16033e-a51a-43c6-9926-7d4fc9b96bd1", "tag": "417af98e-97a4-4636-8e23-5904d61a9d52"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:06.351679 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-9c568e39-fafe-4cf3-ad70-72fe4a45dadf req-d75c2ee9-cbf4-4394-813b-ee5028a9b796 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:06.353516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-9c568e39-fafe-4cf3-ad70-72fe4a45dadf req-d75c2ee9-cbf4-4394-813b-ee5028a9b796 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:06.453072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-9c568e39-fafe-4cf3-ad70-72fe4a45dadf req-d75c2ee9-cbf4-4394-813b-ee5028a9b796 service nova] Creating event network-changed:417af98e-97a4-4636-8e23-5904d61a9d52 for instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 on hv-cinder-79987 Jul 20 22:46:06.453072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-9c568e39-fafe-4cf3-ad70-72fe4a45dadf req-d75c2ee9-cbf4-4394-813b-ee5028a9b796 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124913) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 22:46:06.453072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-19680402-34d2-47ad-9df0-da20d5880c9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:06.453072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-19680402-34d2-47ad-9df0-da20d5880c9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:06.453072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-19680402-34d2-47ad-9df0-da20d5880c9f None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:06.454043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-19680402-34d2-47ad-9df0-da20d5880c9f None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:06.454043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.compute.rpcapi [None req-19680402-34d2-47ad-9df0-da20d5880c9f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 22:46:06.454043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-19680402-34d2-47ad-9df0-da20d5880c9f None None] Releasing lock "compute-rpcapi-router" {{(pid=124913) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 22:46:06.454304 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-12afb8ab-54c0-4a77-9af9-1c8eae4165c2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:06.454304 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-12afb8ab-54c0-4a77-9af9-1c8eae4165c2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1299 microversion: 2.1 time: 0.234424 Jul 20 22:46:06.454304 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 52/101] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:06 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:06.454511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-19680402-34d2-47ad-9df0-da20d5880c9f None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.424358 Jul 20 22:46:06.454511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 50/102] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:46:06.616454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-50bb72ed-e0b4-456b-a61f-f970ea1b2ff1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:06.617124 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-50bb72ed-e0b4-456b-a61f-f970ea1b2ff1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:06.623180 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-50bb72ed-e0b4-456b-a61f-f970ea1b2ff1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:06.623617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-50bb72ed-e0b4-456b-a61f-f970ea1b2ff1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:06.624384 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-50bb72ed-e0b4-456b-a61f-f970ea1b2ff1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:06.625371 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-50bb72ed-e0b4-456b-a61f-f970ea1b2ff1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:06.757935 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-50bb72ed-e0b4-456b-a61f-f970ea1b2ff1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:06.767620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-50bb72ed-e0b4-456b-a61f-f970ea1b2ff1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.154866 Jul 20 22:46:06.768122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 53/103] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:06 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:07.032379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-970afeb8-1907-45e0-a2ac-2a71537c7951 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:07.033304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-970afeb8-1907-45e0-a2ac-2a71537c7951 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:07.053974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-970afeb8-1907-45e0-a2ac-2a71537c7951 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.054846 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-970afeb8-1907-45e0-a2ac-2a71537c7951 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.056025 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-970afeb8-1907-45e0-a2ac-2a71537c7951 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.067308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-970afeb8-1907-45e0-a2ac-2a71537c7951 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.398467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-970afeb8-1907-45e0-a2ac-2a71537c7951 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:07.413176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-970afeb8-1907-45e0-a2ac-2a71537c7951 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.383227 Jul 20 22:46:07.413176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 51/104] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:07 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:07.434554 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d8b555e8-91d7-4e64-8822-8529072702b0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:07.437531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d8b555e8-91d7-4e64-8822-8529072702b0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:07.458946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8b555e8-91d7-4e64-8822-8529072702b0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.458946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8b555e8-91d7-4e64-8822-8529072702b0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.464703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-1fe221fc-f165-4cf2-b489-5af74ff8ea7c req-6cb04a2e-6f02-4a3c-ad12-1de520a695b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824101ca-4631-4acf-a133-48665389e37a", "tag": "690240d6-0f53-4a3c-839f-1fa4c80f81d8"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:07.473448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8b555e8-91d7-4e64-8822-8529072702b0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.474536 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8b555e8-91d7-4e64-8822-8529072702b0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.502498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-1fe221fc-f165-4cf2-b489-5af74ff8ea7c req-6cb04a2e-6f02-4a3c-ad12-1de520a695b5 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.504078 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-1fe221fc-f165-4cf2-b489-5af74ff8ea7c req-6cb04a2e-6f02-4a3c-ad12-1de520a695b5 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.556441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-1fe221fc-f165-4cf2-b489-5af74ff8ea7c req-6cb04a2e-6f02-4a3c-ad12-1de520a695b5 service nova] Creating event network-changed:690240d6-0f53-4a3c-839f-1fa4c80f81d8 for instance 824101ca-4631-4acf-a133-48665389e37a on hv-cinder-79987 Jul 20 22:46:07.556441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-1fe221fc-f165-4cf2-b489-5af74ff8ea7c req-6cb04a2e-6f02-4a3c-ad12-1de520a695b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124912) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 22:46:07.586359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3aca90c-97e8-4f27-a1c9-076a233dbe38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.586817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3aca90c-97e8-4f27-a1c9-076a233dbe38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.587744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3aca90c-97e8-4f27-a1c9-076a233dbe38 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.596570 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3aca90c-97e8-4f27-a1c9-076a233dbe38 None None] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.625771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.compute.rpcapi [None req-a3aca90c-97e8-4f27-a1c9-076a233dbe38 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 22:46:07.633647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3aca90c-97e8-4f27-a1c9-076a233dbe38 None None] Releasing lock "compute-rpcapi-router" {{(pid=124912) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 22:46:07.686234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a3aca90c-97e8-4f27-a1c9-076a233dbe38 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.477152 Jul 20 22:46:07.686234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 54/105] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:46:07.695920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c55f1b93-ef63-4dfb-8804-9c1f000243eb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:07.697164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c55f1b93-ef63-4dfb-8804-9c1f000243eb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:07.729478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c55f1b93-ef63-4dfb-8804-9c1f000243eb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.729478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c55f1b93-ef63-4dfb-8804-9c1f000243eb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.729478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c55f1b93-ef63-4dfb-8804-9c1f000243eb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.729478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c55f1b93-ef63-4dfb-8804-9c1f000243eb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.792270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d8b555e8-91d7-4e64-8822-8529072702b0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:07.802794 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d8b555e8-91d7-4e64-8822-8529072702b0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.391622 Jul 20 22:46:07.803698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 52/106] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:07 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:07.808195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7798073c-0b4f-4a94-bac0-67714a6118b7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:07.809004 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7798073c-0b4f-4a94-bac0-67714a6118b7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:07.820719 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7798073c-0b4f-4a94-bac0-67714a6118b7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.821272 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7798073c-0b4f-4a94-bac0-67714a6118b7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.829265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7798073c-0b4f-4a94-bac0-67714a6118b7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:07.829265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7798073c-0b4f-4a94-bac0-67714a6118b7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:07.986920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c55f1b93-ef63-4dfb-8804-9c1f000243eb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:07.987408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7798073c-0b4f-4a94-bac0-67714a6118b7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:07.998907 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7798073c-0b4f-4a94-bac0-67714a6118b7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.193728 Jul 20 22:46:08.000226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c55f1b93-ef63-4dfb-8804-9c1f000243eb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.323448 Jul 20 22:46:08.001101 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 55/107] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:07 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:08.007579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 53/108] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:07 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:08.429059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ee0f76b6-cb48-433c-9014-72142902edd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:08.429668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ee0f76b6-cb48-433c-9014-72142902edd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:08.435994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ee0f76b6-cb48-433c-9014-72142902edd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:08.436434 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ee0f76b6-cb48-433c-9014-72142902edd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:08.437341 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ee0f76b6-cb48-433c-9014-72142902edd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:08.437830 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ee0f76b6-cb48-433c-9014-72142902edd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:08.569863 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ee0f76b6-cb48-433c-9014-72142902edd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:08.578506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ee0f76b6-cb48-433c-9014-72142902edd7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.152484 Jul 20 22:46:08.581038 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 56/109] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:08 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:08.820749 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9ac4f662-d257-41ff-90e2-f8539ba702d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:08.821495 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9ac4f662-d257-41ff-90e2-f8539ba702d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:08.828752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9ac4f662-d257-41ff-90e2-f8539ba702d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:08.829541 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9ac4f662-d257-41ff-90e2-f8539ba702d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:08.830439 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9ac4f662-d257-41ff-90e2-f8539ba702d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:08.830933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9ac4f662-d257-41ff-90e2-f8539ba702d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:08.961952 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9ac4f662-d257-41ff-90e2-f8539ba702d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:08.969521 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9ac4f662-d257-41ff-90e2-f8539ba702d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.153178 Jul 20 22:46:08.970085 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 54/110] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:08 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:09.016090 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7765ee3b-5a98-4ec9-b50c-dfdc694ef240 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:09.016696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7765ee3b-5a98-4ec9-b50c-dfdc694ef240 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:09.016808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-64d8b63f-f4ac-4fa1-84ec-c7961900ab7c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:09.017338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-64d8b63f-f4ac-4fa1-84ec-c7961900ab7c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:09.022758 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7765ee3b-5a98-4ec9-b50c-dfdc694ef240 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.023195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64d8b63f-f4ac-4fa1-84ec-c7961900ab7c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.023310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7765ee3b-5a98-4ec9-b50c-dfdc694ef240 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:09.023640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64d8b63f-f4ac-4fa1-84ec-c7961900ab7c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:09.024038 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7765ee3b-5a98-4ec9-b50c-dfdc694ef240 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.024391 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64d8b63f-f4ac-4fa1-84ec-c7961900ab7c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.024495 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7765ee3b-5a98-4ec9-b50c-dfdc694ef240 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:09.024820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64d8b63f-f4ac-4fa1-84ec-c7961900ab7c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:09.042606 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:09.160868 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7765ee3b-5a98-4ec9-b50c-dfdc694ef240 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:09.162376 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-64d8b63f-f4ac-4fa1-84ec-c7961900ab7c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:09.164699 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:09.168999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7765ee3b-5a98-4ec9-b50c-dfdc694ef240 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.157384 Jul 20 22:46:09.169571 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-64d8b63f-f4ac-4fa1-84ec-c7961900ab7c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.157137 Jul 20 22:46:09.169710 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 57/111] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:09 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:09.170128 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 55/112] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:09 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:09.595204 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-852944d4-3acf-4e0d-adef-5315baed1e03 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:09.595806 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-852944d4-3acf-4e0d-adef-5315baed1e03 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:09.602098 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-852944d4-3acf-4e0d-adef-5315baed1e03 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.606716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-852944d4-3acf-4e0d-adef-5315baed1e03 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:09.606716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-852944d4-3acf-4e0d-adef-5315baed1e03 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.606716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-852944d4-3acf-4e0d-adef-5315baed1e03 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:09.692801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-13bec579-d314-4277-9a29-00dfc6bfe32c req-b7062ca9-4ee0-4b6c-9519-73331a084f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed11a51a-3574-43eb-a485-e6df2ded9fee", "tag": "f1feda7d-23f5-45c6-aa8d-8ed0915aa1ec"}, {"name": "network-changed", "server_uuid": "cce8a500-8166-4cb3-bc33-41c35ef48651", "tag": "10d19aff-cf1c-4e78-abf5-f4fd95873ab9"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:09.702198 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-13bec579-d314-4277-9a29-00dfc6bfe32c req-b7062ca9-4ee0-4b6c-9519-73331a084f4a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.702651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-13bec579-d314-4277-9a29-00dfc6bfe32c req-b7062ca9-4ee0-4b6c-9519-73331a084f4a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:09.715551 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-13bec579-d314-4277-9a29-00dfc6bfe32c req-b7062ca9-4ee0-4b6c-9519-73331a084f4a service nova] Creating event network-changed:f1feda7d-23f5-45c6-aa8d-8ed0915aa1ec for instance ed11a51a-3574-43eb-a485-e6df2ded9fee on hv-cinder-79987 Jul 20 22:46:09.716047 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-13bec579-d314-4277-9a29-00dfc6bfe32c req-b7062ca9-4ee0-4b6c-9519-73331a084f4a service nova] Creating event network-changed:10d19aff-cf1c-4e78-abf5-f4fd95873ab9 for instance cce8a500-8166-4cb3-bc33-41c35ef48651 on hv-cinder-79987 Jul 20 22:46:09.725188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-13bec579-d314-4277-9a29-00dfc6bfe32c req-b7062ca9-4ee0-4b6c-9519-73331a084f4a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033959 Jul 20 22:46:09.725188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 56/113] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:46:09.740385 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-852944d4-3acf-4e0d-adef-5315baed1e03 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:09.747847 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-852944d4-3acf-4e0d-adef-5315baed1e03 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.156496 Jul 20 22:46:09.748710 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 58/114] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:09 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:09.987536 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a70dfba7-6b10-4822-872c-616b9ec945f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:09.988251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a70dfba7-6b10-4822-872c-616b9ec945f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:09.994781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a70dfba7-6b10-4822-872c-616b9ec945f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.995336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a70dfba7-6b10-4822-872c-616b9ec945f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:09.996107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a70dfba7-6b10-4822-872c-616b9ec945f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:09.996534 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a70dfba7-6b10-4822-872c-616b9ec945f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:10.123796 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a70dfba7-6b10-4822-872c-616b9ec945f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:10.131239 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a70dfba7-6b10-4822-872c-616b9ec945f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.148540 Jul 20 22:46:10.131808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 57/115] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:09 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:10.186466 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b55cff64-563c-4edf-ac58-71e9f666ce5b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:10.186912 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b55cff64-563c-4edf-ac58-71e9f666ce5b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:10.189162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-948b8b34-7af3-43fc-8180-0745d1403ff4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:10.194063 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-948b8b34-7af3-43fc-8180-0745d1403ff4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:10.194184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b55cff64-563c-4edf-ac58-71e9f666ce5b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:10.194184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b55cff64-563c-4edf-ac58-71e9f666ce5b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:10.194461 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b55cff64-563c-4edf-ac58-71e9f666ce5b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:10.194888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b55cff64-563c-4edf-ac58-71e9f666ce5b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:10.197064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-948b8b34-7af3-43fc-8180-0745d1403ff4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:10.197780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-948b8b34-7af3-43fc-8180-0745d1403ff4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:10.198256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-948b8b34-7af3-43fc-8180-0745d1403ff4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:10.198923 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-948b8b34-7af3-43fc-8180-0745d1403ff4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:10.331073 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b55cff64-563c-4edf-ac58-71e9f666ce5b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:10.331241 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-948b8b34-7af3-43fc-8180-0745d1403ff4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:10.338911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-948b8b34-7af3-43fc-8180-0745d1403ff4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.153493 Jul 20 22:46:10.339550 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 58/116] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:10 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:10.340749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b55cff64-563c-4edf-ac58-71e9f666ce5b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.158885 Jul 20 22:46:10.341471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 59/117] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:10 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:10.763863 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6fb2aa94-8a8d-41d4-a43f-5b3105ab7142 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:10.764471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6fb2aa94-8a8d-41d4-a43f-5b3105ab7142 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:10.771131 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa94-8a8d-41d4-a43f-5b3105ab7142 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:10.771573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa94-8a8d-41d4-a43f-5b3105ab7142 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:10.772358 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa94-8a8d-41d4-a43f-5b3105ab7142 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:10.772788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6fb2aa94-8a8d-41d4-a43f-5b3105ab7142 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:10.906124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6fb2aa94-8a8d-41d4-a43f-5b3105ab7142 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:10.913963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6fb2aa94-8a8d-41d4-a43f-5b3105ab7142 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.153849 Jul 20 22:46:10.914534 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 59/118] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:10 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:11.148531 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3b9b294a-7bd3-4f7e-be70-e44cb5a6b46f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:11.149062 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3b9b294a-7bd3-4f7e-be70-e44cb5a6b46f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:11.155110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b9b294a-7bd3-4f7e-be70-e44cb5a6b46f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:11.155556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b9b294a-7bd3-4f7e-be70-e44cb5a6b46f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:11.156308 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b9b294a-7bd3-4f7e-be70-e44cb5a6b46f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:11.156743 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b9b294a-7bd3-4f7e-be70-e44cb5a6b46f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:11.285440 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3b9b294a-7bd3-4f7e-be70-e44cb5a6b46f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:11.293431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3b9b294a-7bd3-4f7e-be70-e44cb5a6b46f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.148509 Jul 20 22:46:11.294005 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 60/119] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:11 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:11.356120 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e548f878-2f3f-4e64-8fbd-48ccd52efe7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:11.356729 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e548f878-2f3f-4e64-8fbd-48ccd52efe7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:11.357287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-57ffdefb-28b2-4d6e-91ef-c629213c1c10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:11.357897 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-57ffdefb-28b2-4d6e-91ef-c629213c1c10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:11.363349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e548f878-2f3f-4e64-8fbd-48ccd52efe7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:11.363793 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e548f878-2f3f-4e64-8fbd-48ccd52efe7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:11.364450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-57ffdefb-28b2-4d6e-91ef-c629213c1c10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:11.364581 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e548f878-2f3f-4e64-8fbd-48ccd52efe7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:11.364894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-57ffdefb-28b2-4d6e-91ef-c629213c1c10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:11.364985 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e548f878-2f3f-4e64-8fbd-48ccd52efe7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:11.365655 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-57ffdefb-28b2-4d6e-91ef-c629213c1c10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:11.366086 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-57ffdefb-28b2-4d6e-91ef-c629213c1c10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:11.494629 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e548f878-2f3f-4e64-8fbd-48ccd52efe7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:11.497659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-57ffdefb-28b2-4d6e-91ef-c629213c1c10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:11.502084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e548f878-2f3f-4e64-8fbd-48ccd52efe7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.149737 Jul 20 22:46:11.502799 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 60/120] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:11 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:11.505427 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-57ffdefb-28b2-4d6e-91ef-c629213c1c10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.151883 Jul 20 22:46:11.506335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 61/121] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:11 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:11.931057 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d1973c22-7de9-4716-8789-ca1a0d4dade0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:11.931735 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d1973c22-7de9-4716-8789-ca1a0d4dade0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:11.938228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d1973c22-7de9-4716-8789-ca1a0d4dade0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:11.938666 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d1973c22-7de9-4716-8789-ca1a0d4dade0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:11.939446 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d1973c22-7de9-4716-8789-ca1a0d4dade0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:11.939880 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d1973c22-7de9-4716-8789-ca1a0d4dade0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:12.069027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d1973c22-7de9-4716-8789-ca1a0d4dade0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:12.076499 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d1973c22-7de9-4716-8789-ca1a0d4dade0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.149212 Jul 20 22:46:12.077071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 61/122] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:11 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:12.310825 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-28bb28fa-779d-4105-9b21-24d528c58217 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:12.314322 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-28bb28fa-779d-4105-9b21-24d528c58217 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:12.318337 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-28bb28fa-779d-4105-9b21-24d528c58217 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:12.318778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-28bb28fa-779d-4105-9b21-24d528c58217 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:12.319555 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-28bb28fa-779d-4105-9b21-24d528c58217 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:12.319981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-28bb28fa-779d-4105-9b21-24d528c58217 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:12.446749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-28bb28fa-779d-4105-9b21-24d528c58217 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:12.454719 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-28bb28fa-779d-4105-9b21-24d528c58217 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.147731 Jul 20 22:46:12.455385 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 62/123] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:12 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:12.518828 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f2a91937-873b-4c3b-a550-54c4db0a8f42 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:12.519484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f2a91937-873b-4c3b-a550-54c4db0a8f42 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:12.521763 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9e0bc2e2-7ed5-4ed7-ab65-667b6bebb4e0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:12.522403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9e0bc2e2-7ed5-4ed7-ab65-667b6bebb4e0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:12.525717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f2a91937-873b-4c3b-a550-54c4db0a8f42 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:12.526156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f2a91937-873b-4c3b-a550-54c4db0a8f42 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:12.526906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f2a91937-873b-4c3b-a550-54c4db0a8f42 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:12.527353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f2a91937-873b-4c3b-a550-54c4db0a8f42 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:12.528339 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e0bc2e2-7ed5-4ed7-ab65-667b6bebb4e0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:12.528785 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e0bc2e2-7ed5-4ed7-ab65-667b6bebb4e0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:12.529541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e0bc2e2-7ed5-4ed7-ab65-667b6bebb4e0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:12.529977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e0bc2e2-7ed5-4ed7-ab65-667b6bebb4e0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:12.659531 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9e0bc2e2-7ed5-4ed7-ab65-667b6bebb4e0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:12.660308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f2a91937-873b-4c3b-a550-54c4db0a8f42 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:12.667114 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9e0bc2e2-7ed5-4ed7-ab65-667b6bebb4e0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.149127 Jul 20 22:46:12.667690 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 63/124] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:12 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:12.668012 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f2a91937-873b-4c3b-a550-54c4db0a8f42 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.153751 Jul 20 22:46:12.668570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 62/125] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:12 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:13.094207 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-25f73181-c9c8-49db-8599-1a8f928432b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:13.094817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-25f73181-c9c8-49db-8599-1a8f928432b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:13.100819 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-25f73181-c9c8-49db-8599-1a8f928432b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:13.101261 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-25f73181-c9c8-49db-8599-1a8f928432b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:13.102009 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-25f73181-c9c8-49db-8599-1a8f928432b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:13.102434 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-25f73181-c9c8-49db-8599-1a8f928432b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:13.237816 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-25f73181-c9c8-49db-8599-1a8f928432b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:13.245258 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-25f73181-c9c8-49db-8599-1a8f928432b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.155455 Jul 20 22:46:13.245820 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 64/126] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:13 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:13.474109 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fb93805f-5c84-4eac-aa0f-3a70c9aa1f71 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:13.474714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fb93805f-5c84-4eac-aa0f-3a70c9aa1f71 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:13.481456 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb93805f-5c84-4eac-aa0f-3a70c9aa1f71 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:13.482301 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb93805f-5c84-4eac-aa0f-3a70c9aa1f71 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:13.483316 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb93805f-5c84-4eac-aa0f-3a70c9aa1f71 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:13.485337 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb93805f-5c84-4eac-aa0f-3a70c9aa1f71 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:13.685784 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3eb403db-3cfe-4de0-a421-98b48f4b6b89 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:13.686868 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3eb403db-3cfe-4de0-a421-98b48f4b6b89 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:13.693262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3eb403db-3cfe-4de0-a421-98b48f4b6b89 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:13.693707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3eb403db-3cfe-4de0-a421-98b48f4b6b89 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:13.694757 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3eb403db-3cfe-4de0-a421-98b48f4b6b89 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:13.695261 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3eb403db-3cfe-4de0-a421-98b48f4b6b89 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:13.773333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fb93805f-5c84-4eac-aa0f-3a70c9aa1f71 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:13.779511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fb93805f-5c84-4eac-aa0f-3a70c9aa1f71 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.311558 Jul 20 22:46:13.793936 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 63/127] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:13 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:13.806168 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-30843a9a-fc02-4672-8a92-f369350e9f0c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:13.810831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-30843a9a-fc02-4672-8a92-f369350e9f0c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:13.819862 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-30843a9a-fc02-4672-8a92-f369350e9f0c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:13.821288 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-30843a9a-fc02-4672-8a92-f369350e9f0c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:13.822158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-30843a9a-fc02-4672-8a92-f369350e9f0c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:13.822959 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-30843a9a-fc02-4672-8a92-f369350e9f0c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:14.144997 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-30843a9a-fc02-4672-8a92-f369350e9f0c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:14.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-30843a9a-fc02-4672-8a92-f369350e9f0c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.357862 Jul 20 22:46:14.162106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 64/128] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:13 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:14.264419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ca902ea6-9330-4ca1-b531-9e8b8d5fd67e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:14.265201 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ca902ea6-9330-4ca1-b531-9e8b8d5fd67e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:14.271160 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ca902ea6-9330-4ca1-b531-9e8b8d5fd67e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:14.271614 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ca902ea6-9330-4ca1-b531-9e8b8d5fd67e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:14.272379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ca902ea6-9330-4ca1-b531-9e8b8d5fd67e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:14.272817 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ca902ea6-9330-4ca1-b531-9e8b8d5fd67e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:14.489820 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3eb403db-3cfe-4de0-a421-98b48f4b6b89 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:14.499639 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3eb403db-3cfe-4de0-a421-98b48f4b6b89 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.818899 Jul 20 22:46:14.506256 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 65/129] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:13 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:14.805529 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b5ddc516-dd13-4aaa-96de-a5b221628935 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:14.810877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b5ddc516-dd13-4aaa-96de-a5b221628935 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:14.811752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ca902ea6-9330-4ca1-b531-9e8b8d5fd67e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:14.824245 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ca902ea6-9330-4ca1-b531-9e8b8d5fd67e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.563352 Jul 20 22:46:14.835374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 65/130] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:14 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:14.837698 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5ddc516-dd13-4aaa-96de-a5b221628935 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:14.838144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5ddc516-dd13-4aaa-96de-a5b221628935 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:14.838934 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5ddc516-dd13-4aaa-96de-a5b221628935 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:14.839386 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5ddc516-dd13-4aaa-96de-a5b221628935 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:15.003542 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b5ddc516-dd13-4aaa-96de-a5b221628935 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:15.011558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b5ddc516-dd13-4aaa-96de-a5b221628935 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.217366 Jul 20 22:46:15.012238 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 66/131] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:14 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:15.119149 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-8ae93a22-a5c4-41e2-bb01-515c0f6e3f57 req-a8cc3083-b351-4a23-9c34-67254b8911f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26d2070-596e-440d-8b3b-39be974f5bd3", "tag": "3ef07cb8-939b-46e3-b2ca-eedb58f07b4a"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:15.132516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-8ae93a22-a5c4-41e2-bb01-515c0f6e3f57 req-a8cc3083-b351-4a23-9c34-67254b8911f1 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:15.132970 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-8ae93a22-a5c4-41e2-bb01-515c0f6e3f57 req-a8cc3083-b351-4a23-9c34-67254b8911f1 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:15.150645 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-8ae93a22-a5c4-41e2-bb01-515c0f6e3f57 req-a8cc3083-b351-4a23-9c34-67254b8911f1 service nova] Creating event network-changed:3ef07cb8-939b-46e3-b2ca-eedb58f07b4a for instance b26d2070-596e-440d-8b3b-39be974f5bd3 on hv-cinder-79987 Jul 20 22:46:15.157138 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-8ae93a22-a5c4-41e2-bb01-515c0f6e3f57 req-a8cc3083-b351-4a23-9c34-67254b8911f1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045040 Jul 20 22:46:15.158273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 66/132] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:46:15.188221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a8143728-17ce-4ebe-9697-9c8d44627329 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:15.189090 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a8143728-17ce-4ebe-9697-9c8d44627329 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:15.208491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a8143728-17ce-4ebe-9697-9c8d44627329 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:15.208946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a8143728-17ce-4ebe-9697-9c8d44627329 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:15.209731 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a8143728-17ce-4ebe-9697-9c8d44627329 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:15.210166 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a8143728-17ce-4ebe-9697-9c8d44627329 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:15.382504 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a8143728-17ce-4ebe-9697-9c8d44627329 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:15.390889 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a8143728-17ce-4ebe-9697-9c8d44627329 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.218658 Jul 20 22:46:15.391787 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 67/133] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:15 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:15.523413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-230f64bf-d790-4408-bfe8-144b6d23f0c0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:15.524109 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-230f64bf-d790-4408-bfe8-144b6d23f0c0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:15.530158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-230f64bf-d790-4408-bfe8-144b6d23f0c0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:15.531208 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-230f64bf-d790-4408-bfe8-144b6d23f0c0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:15.531963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-230f64bf-d790-4408-bfe8-144b6d23f0c0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:15.532444 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-230f64bf-d790-4408-bfe8-144b6d23f0c0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:15.699403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-230f64bf-d790-4408-bfe8-144b6d23f0c0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:15.710779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-230f64bf-d790-4408-bfe8-144b6d23f0c0 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.188355 Jul 20 22:46:15.710779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 67/134] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:15 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:15.841620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3df5c51e-c641-4582-9ff1-76fd50ddbe3e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:15.842233 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3df5c51e-c641-4582-9ff1-76fd50ddbe3e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:15.848421 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3df5c51e-c641-4582-9ff1-76fd50ddbe3e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:15.848859 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3df5c51e-c641-4582-9ff1-76fd50ddbe3e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:15.849643 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3df5c51e-c641-4582-9ff1-76fd50ddbe3e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:15.850069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3df5c51e-c641-4582-9ff1-76fd50ddbe3e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:15.997487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3df5c51e-c641-4582-9ff1-76fd50ddbe3e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:16.005780 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3df5c51e-c641-4582-9ff1-76fd50ddbe3e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.167994 Jul 20 22:46:16.006361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 68/135] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:15 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:16.028999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-822c89e5-9d83-486d-aabd-00f1cfc67a40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:16.029600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-822c89e5-9d83-486d-aabd-00f1cfc67a40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:16.035869 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-822c89e5-9d83-486d-aabd-00f1cfc67a40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:16.036312 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-822c89e5-9d83-486d-aabd-00f1cfc67a40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:16.037056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-822c89e5-9d83-486d-aabd-00f1cfc67a40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:16.037506 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-822c89e5-9d83-486d-aabd-00f1cfc67a40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:16.167669 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-822c89e5-9d83-486d-aabd-00f1cfc67a40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:16.175740 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-822c89e5-9d83-486d-aabd-00f1cfc67a40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.150537 Jul 20 22:46:16.179576 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 68/136] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:16 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:16.407542 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ce63d76a-848c-4ea8-9fd2-e21634cedd51 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:16.408100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ce63d76a-848c-4ea8-9fd2-e21634cedd51 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:16.414696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce63d76a-848c-4ea8-9fd2-e21634cedd51 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:16.415174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce63d76a-848c-4ea8-9fd2-e21634cedd51 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:16.415932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce63d76a-848c-4ea8-9fd2-e21634cedd51 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:16.416400 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce63d76a-848c-4ea8-9fd2-e21634cedd51 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:16.545162 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ce63d76a-848c-4ea8-9fd2-e21634cedd51 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:16.553232 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ce63d76a-848c-4ea8-9fd2-e21634cedd51 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.149876 Jul 20 22:46:16.553851 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 69/137] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:16 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:16.724543 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d21bc23a-faae-43c4-9bb5-5bb67dbdb0e9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:16.725152 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d21bc23a-faae-43c4-9bb5-5bb67dbdb0e9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:16.727197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:16.732070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d21bc23a-faae-43c4-9bb5-5bb67dbdb0e9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:16.732515 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d21bc23a-faae-43c4-9bb5-5bb67dbdb0e9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:16.733313 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d21bc23a-faae-43c4-9bb5-5bb67dbdb0e9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:16.734298 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d21bc23a-faae-43c4-9bb5-5bb67dbdb0e9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:16.863411 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d21bc23a-faae-43c4-9bb5-5bb67dbdb0e9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:16.873339 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d21bc23a-faae-43c4-9bb5-5bb67dbdb0e9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.152742 Jul 20 22:46:16.874135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 69/138] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:16 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:17.025101 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-bfef4315-3d80-4619-8c95-dc8843aadcd1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:17.025919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-bfef4315-3d80-4619-8c95-dc8843aadcd1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:17.032615 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bfef4315-3d80-4619-8c95-dc8843aadcd1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:17.033059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bfef4315-3d80-4619-8c95-dc8843aadcd1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:17.034067 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bfef4315-3d80-4619-8c95-dc8843aadcd1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:17.034498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bfef4315-3d80-4619-8c95-dc8843aadcd1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:17.163815 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-bfef4315-3d80-4619-8c95-dc8843aadcd1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:17.171397 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-bfef4315-3d80-4619-8c95-dc8843aadcd1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.149935 Jul 20 22:46:17.171964 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 70/139] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:17 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:17.194464 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e71702ff-e68b-486e-a175-7daf1c7aa0ba tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:17.194975 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e71702ff-e68b-486e-a175-7daf1c7aa0ba tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:17.201143 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e71702ff-e68b-486e-a175-7daf1c7aa0ba tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:17.201693 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e71702ff-e68b-486e-a175-7daf1c7aa0ba tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:17.202944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e71702ff-e68b-486e-a175-7daf1c7aa0ba tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:17.203404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e71702ff-e68b-486e-a175-7daf1c7aa0ba tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:17.340875 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e71702ff-e68b-486e-a175-7daf1c7aa0ba tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:17.345941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e71702ff-e68b-486e-a175-7daf1c7aa0ba tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.156204 Jul 20 22:46:17.346508 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 70/140] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:17 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:17.569402 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3158ff13-3163-485a-bf76-c764c9b84942 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:17.570064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3158ff13-3163-485a-bf76-c764c9b84942 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:17.575958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3158ff13-3163-485a-bf76-c764c9b84942 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:17.576395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3158ff13-3163-485a-bf76-c764c9b84942 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:17.577147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3158ff13-3163-485a-bf76-c764c9b84942 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:17.577572 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3158ff13-3163-485a-bf76-c764c9b84942 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:17.625273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:17.740247 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3158ff13-3163-485a-bf76-c764c9b84942 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:17.747586 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3158ff13-3163-485a-bf76-c764c9b84942 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.181903 Jul 20 22:46:17.748148 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 71/141] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:17 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:17.892073 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-eee9ac08-158a-4219-8e76-6012bcf69c7d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:17.892680 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-eee9ac08-158a-4219-8e76-6012bcf69c7d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:17.898667 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eee9ac08-158a-4219-8e76-6012bcf69c7d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:17.899154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eee9ac08-158a-4219-8e76-6012bcf69c7d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:17.899913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eee9ac08-158a-4219-8e76-6012bcf69c7d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:17.900345 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eee9ac08-158a-4219-8e76-6012bcf69c7d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:18.065267 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-eee9ac08-158a-4219-8e76-6012bcf69c7d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:18.074998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-eee9ac08-158a-4219-8e76-6012bcf69c7d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.186546 Jul 20 22:46:18.075702 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 71/142] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:17 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:18.189100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-eff43772-be31-4f1c-a63f-2258e8763649 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:18.190627 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-eff43772-be31-4f1c-a63f-2258e8763649 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:18.195838 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-eff43772-be31-4f1c-a63f-2258e8763649 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:18.196282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-eff43772-be31-4f1c-a63f-2258e8763649 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:18.197408 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-eff43772-be31-4f1c-a63f-2258e8763649 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:18.197504 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-eff43772-be31-4f1c-a63f-2258e8763649 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:18.328768 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-eff43772-be31-4f1c-a63f-2258e8763649 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:18.336293 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-eff43772-be31-4f1c-a63f-2258e8763649 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.150981 Jul 20 22:46:18.336857 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 72/143] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:18 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:18.363322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4bae6f8e-de09-49f4-88a8-ce4c12d34f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:18.364340 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4bae6f8e-de09-49f4-88a8-ce4c12d34f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:18.370832 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4bae6f8e-de09-49f4-88a8-ce4c12d34f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:18.371561 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4bae6f8e-de09-49f4-88a8-ce4c12d34f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:18.372364 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4bae6f8e-de09-49f4-88a8-ce4c12d34f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:18.372931 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4bae6f8e-de09-49f4-88a8-ce4c12d34f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:18.505232 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4bae6f8e-de09-49f4-88a8-ce4c12d34f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:18.512870 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4bae6f8e-de09-49f4-88a8-ce4c12d34f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.153375 Jul 20 22:46:18.513433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 72/144] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:18 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:18.766439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-106dadd5-dabe-49d4-8203-5b22b237151a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:18.767071 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-106dadd5-dabe-49d4-8203-5b22b237151a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:18.773299 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-106dadd5-dabe-49d4-8203-5b22b237151a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:18.773743 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-106dadd5-dabe-49d4-8203-5b22b237151a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:18.774505 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-106dadd5-dabe-49d4-8203-5b22b237151a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:18.774935 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-106dadd5-dabe-49d4-8203-5b22b237151a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:18.907671 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-106dadd5-dabe-49d4-8203-5b22b237151a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:18.915677 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-106dadd5-dabe-49d4-8203-5b22b237151a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.154233 Jul 20 22:46:18.916234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 73/145] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:18 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:19.091639 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ffcc5e71-b6d5-4d43-8d08-fcd855679fd6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:19.108049 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ffcc5e71-b6d5-4d43-8d08-fcd855679fd6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:19.108049 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffcc5e71-b6d5-4d43-8d08-fcd855679fd6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:19.108049 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffcc5e71-b6d5-4d43-8d08-fcd855679fd6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:19.108049 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffcc5e71-b6d5-4d43-8d08-fcd855679fd6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:19.108494 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffcc5e71-b6d5-4d43-8d08-fcd855679fd6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:19.118274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:19.269273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ffcc5e71-b6d5-4d43-8d08-fcd855679fd6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:19.277083 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ffcc5e71-b6d5-4d43-8d08-fcd855679fd6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.188880 Jul 20 22:46:19.278529 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 73/146] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:19 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:19.353315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-01b6928b-406c-4502-b287-145a682f8926 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:19.353934 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-01b6928b-406c-4502-b287-145a682f8926 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:19.360452 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-01b6928b-406c-4502-b287-145a682f8926 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:19.360895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-01b6928b-406c-4502-b287-145a682f8926 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:19.361781 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-01b6928b-406c-4502-b287-145a682f8926 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:19.362207 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-01b6928b-406c-4502-b287-145a682f8926 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:19.381118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:19.503453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-01b6928b-406c-4502-b287-145a682f8926 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:19.510674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-01b6928b-406c-4502-b287-145a682f8926 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.161230 Jul 20 22:46:19.511268 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 74/147] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:19 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:19.529539 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-26048341-598a-4ea5-b8f7-3508c8b8c850 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:19.530597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-26048341-598a-4ea5-b8f7-3508c8b8c850 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:19.536911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-26048341-598a-4ea5-b8f7-3508c8b8c850 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:19.537402 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-26048341-598a-4ea5-b8f7-3508c8b8c850 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:19.538199 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-26048341-598a-4ea5-b8f7-3508c8b8c850 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:19.538630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-26048341-598a-4ea5-b8f7-3508c8b8c850 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:19.672036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-26048341-598a-4ea5-b8f7-3508c8b8c850 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:19.679803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-26048341-598a-4ea5-b8f7-3508c8b8c850 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.154053 Jul 20 22:46:19.680397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 74/148] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:19 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:19.933902 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-71f319f8-47a0-4894-bed4-b1f8e956ae0b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:19.934508 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-71f319f8-47a0-4894-bed4-b1f8e956ae0b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:19.941652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-71f319f8-47a0-4894-bed4-b1f8e956ae0b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:19.942096 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-71f319f8-47a0-4894-bed4-b1f8e956ae0b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:19.942854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-71f319f8-47a0-4894-bed4-b1f8e956ae0b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:19.943309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-71f319f8-47a0-4894-bed4-b1f8e956ae0b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:20.076516 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-71f319f8-47a0-4894-bed4-b1f8e956ae0b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:20.084381 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-71f319f8-47a0-4894-bed4-b1f8e956ae0b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.153881 Jul 20 22:46:20.084766 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 75/149] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:19 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:20.293950 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-42355c40-e50c-46c5-91c3-6928b453418c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:20.294558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-42355c40-e50c-46c5-91c3-6928b453418c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:20.301302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-42355c40-e50c-46c5-91c3-6928b453418c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:20.301751 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-42355c40-e50c-46c5-91c3-6928b453418c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:20.302512 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-42355c40-e50c-46c5-91c3-6928b453418c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:20.302990 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-42355c40-e50c-46c5-91c3-6928b453418c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:20.443491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-42355c40-e50c-46c5-91c3-6928b453418c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:20.450914 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-42355c40-e50c-46c5-91c3-6928b453418c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.160776 Jul 20 22:46:20.451517 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 75/150] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:20 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:20.527476 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-dd97586f-74c3-4f95-b55c-639cada7a76b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:20.528117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-dd97586f-74c3-4f95-b55c-639cada7a76b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:20.535592 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dd97586f-74c3-4f95-b55c-639cada7a76b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:20.536131 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dd97586f-74c3-4f95-b55c-639cada7a76b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:20.536877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dd97586f-74c3-4f95-b55c-639cada7a76b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:20.537412 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dd97586f-74c3-4f95-b55c-639cada7a76b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:20.695895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dd97586f-74c3-4f95-b55c-639cada7a76b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:20.707594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-dd97586f-74c3-4f95-b55c-639cada7a76b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.183587 Jul 20 22:46:20.711112 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 76/151] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:20 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:20.711264 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-2adc4048-5ba0-4b07-9bf2-277b4f43dc07 req-854476c6-c965-4d5b-9782-71d932276d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd16033e-a51a-43c6-9926-7d4fc9b96bd1", "name": "network-vif-plugged", "status": "completed", "tag": "417af98e-97a4-4636-8e23-5904d61a9d52"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:20.721849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cd8384a7-6a37-487b-80b4-16f499e10711 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:20.723132 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-2adc4048-5ba0-4b07-9bf2-277b4f43dc07 req-854476c6-c965-4d5b-9782-71d932276d8d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:20.723256 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cd8384a7-6a37-487b-80b4-16f499e10711 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:20.723350 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-2adc4048-5ba0-4b07-9bf2-277b4f43dc07 req-854476c6-c965-4d5b-9782-71d932276d8d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:20.730545 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cd8384a7-6a37-487b-80b4-16f499e10711 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:20.731126 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cd8384a7-6a37-487b-80b4-16f499e10711 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:20.732030 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cd8384a7-6a37-487b-80b4-16f499e10711 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:20.732470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cd8384a7-6a37-487b-80b4-16f499e10711 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:20.734400 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-2adc4048-5ba0-4b07-9bf2-277b4f43dc07 req-854476c6-c965-4d5b-9782-71d932276d8d service nova] Creating event network-vif-plugged:417af98e-97a4-4636-8e23-5904d61a9d52 for instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 on hv-cinder-79987 Jul 20 22:46:20.739478 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-2adc4048-5ba0-4b07-9bf2-277b4f43dc07 req-854476c6-c965-4d5b-9782-71d932276d8d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093569 Jul 20 22:46:20.740879 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 76/152] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:46:20.864176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cd8384a7-6a37-487b-80b4-16f499e10711 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:20.871930 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cd8384a7-6a37-487b-80b4-16f499e10711 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.162227 Jul 20 22:46:20.872530 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 77/153] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:20 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:21.101041 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-dcab8271-c84b-4b5e-9c79-d6a82eff910f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:21.101804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-dcab8271-c84b-4b5e-9c79-d6a82eff910f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:21.110440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dcab8271-c84b-4b5e-9c79-d6a82eff910f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:21.111191 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dcab8271-c84b-4b5e-9c79-d6a82eff910f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:21.113008 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dcab8271-c84b-4b5e-9c79-d6a82eff910f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:21.114338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dcab8271-c84b-4b5e-9c79-d6a82eff910f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:21.467842 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-993737d0-d311-4ecc-a7a6-75e331bb2ef9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:21.468647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-993737d0-d311-4ecc-a7a6-75e331bb2ef9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:21.475360 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-993737d0-d311-4ecc-a7a6-75e331bb2ef9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:21.478435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-993737d0-d311-4ecc-a7a6-75e331bb2ef9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:21.478435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-993737d0-d311-4ecc-a7a6-75e331bb2ef9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:21.478435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-993737d0-d311-4ecc-a7a6-75e331bb2ef9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:21.557942 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-dcab8271-c84b-4b5e-9c79-d6a82eff910f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:21.566727 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-dcab8271-c84b-4b5e-9c79-d6a82eff910f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.470036 Jul 20 22:46:21.567671 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 77/154] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:21 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:21.726879 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-efc4f495-b21b-46df-ad49-c9d70af2b24b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:21.727640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-efc4f495-b21b-46df-ad49-c9d70af2b24b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:21.739947 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-efc4f495-b21b-46df-ad49-c9d70af2b24b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:21.740397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-efc4f495-b21b-46df-ad49-c9d70af2b24b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:21.741198 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-efc4f495-b21b-46df-ad49-c9d70af2b24b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:21.741628 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-efc4f495-b21b-46df-ad49-c9d70af2b24b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:22.045236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-efc4f495-b21b-46df-ad49-c9d70af2b24b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:22.053433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-efc4f495-b21b-46df-ad49-c9d70af2b24b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.332368 Jul 20 22:46:22.064844 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 78/155] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:21 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:22.069864 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e9035e64-1e10-4455-96ac-033c2da7f2bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:22.070653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e9035e64-1e10-4455-96ac-033c2da7f2bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:22.083773 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9035e64-1e10-4455-96ac-033c2da7f2bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:22.084518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9035e64-1e10-4455-96ac-033c2da7f2bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:22.088051 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9035e64-1e10-4455-96ac-033c2da7f2bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:22.088051 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9035e64-1e10-4455-96ac-033c2da7f2bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:22.101288 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-993737d0-d311-4ecc-a7a6-75e331bb2ef9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:22.110799 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-993737d0-d311-4ecc-a7a6-75e331bb2ef9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.646705 Jul 20 22:46:22.115669 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 78/156] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:21 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:22.330924 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e9035e64-1e10-4455-96ac-033c2da7f2bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:22.342950 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e9035e64-1e10-4455-96ac-033c2da7f2bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.276793 Jul 20 22:46:22.345392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 79/157] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:22 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:22.584035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3e0976a0-5e5c-4f15-9185-4b552fe61d26 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:22.584642 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3e0976a0-5e5c-4f15-9185-4b552fe61d26 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:22.590807 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3e0976a0-5e5c-4f15-9185-4b552fe61d26 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:22.591292 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3e0976a0-5e5c-4f15-9185-4b552fe61d26 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:22.592048 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3e0976a0-5e5c-4f15-9185-4b552fe61d26 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:22.592971 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3e0976a0-5e5c-4f15-9185-4b552fe61d26 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:22.720585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3e0976a0-5e5c-4f15-9185-4b552fe61d26 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:22.727975 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3e0976a0-5e5c-4f15-9185-4b552fe61d26 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.147943 Jul 20 22:46:22.728538 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 79/158] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:22 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:23.071996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-de42e028-1746-415b-8f6c-c0601ca57d3d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:23.072631 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-de42e028-1746-415b-8f6c-c0601ca57d3d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:23.079363 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-de42e028-1746-415b-8f6c-c0601ca57d3d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:23.079984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-de42e028-1746-415b-8f6c-c0601ca57d3d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:23.080731 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-de42e028-1746-415b-8f6c-c0601ca57d3d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:23.081157 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-de42e028-1746-415b-8f6c-c0601ca57d3d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:23.128351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c219b223-2bb7-4200-bcab-420feba8e486 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:23.129734 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c219b223-2bb7-4200-bcab-420feba8e486 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:23.136236 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c219b223-2bb7-4200-bcab-420feba8e486 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:23.136936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c219b223-2bb7-4200-bcab-420feba8e486 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:23.137931 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c219b223-2bb7-4200-bcab-420feba8e486 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:23.138609 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c219b223-2bb7-4200-bcab-420feba8e486 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:23.234691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-de42e028-1746-415b-8f6c-c0601ca57d3d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:23.242720 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-de42e028-1746-415b-8f6c-c0601ca57d3d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.174512 Jul 20 22:46:23.243328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 80/159] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:23 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:23.283195 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c219b223-2bb7-4200-bcab-420feba8e486 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:23.291047 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c219b223-2bb7-4200-bcab-420feba8e486 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.167933 Jul 20 22:46:23.291618 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 80/160] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:23 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:23.361667 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4c1af492-df99-49e4-bb00-d4ac6893508f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:23.362270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4c1af492-df99-49e4-bb00-d4ac6893508f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:23.365307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:23.369015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4c1af492-df99-49e4-bb00-d4ac6893508f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:23.369645 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4c1af492-df99-49e4-bb00-d4ac6893508f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:23.370407 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4c1af492-df99-49e4-bb00-d4ac6893508f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:23.370837 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4c1af492-df99-49e4-bb00-d4ac6893508f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:23.505299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4c1af492-df99-49e4-bb00-d4ac6893508f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:23.512745 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4c1af492-df99-49e4-bb00-d4ac6893508f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.155163 Jul 20 22:46:23.513304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 81/161] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:23 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:23.744880 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-bf993efe-8cb2-426f-9c11-78ab08fe91a8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:23.745683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-bf993efe-8cb2-426f-9c11-78ab08fe91a8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:23.752560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bf993efe-8cb2-426f-9c11-78ab08fe91a8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:23.753126 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bf993efe-8cb2-426f-9c11-78ab08fe91a8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:23.753940 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bf993efe-8cb2-426f-9c11-78ab08fe91a8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:23.754286 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bf993efe-8cb2-426f-9c11-78ab08fe91a8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:23.930794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-bf993efe-8cb2-426f-9c11-78ab08fe91a8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:23.939364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-bf993efe-8cb2-426f-9c11-78ab08fe91a8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.198107 Jul 20 22:46:23.939931 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 81/162] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:23 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:24.259942 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9cdf458b-2563-44f7-a751-8381aaaf6f0a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:24.260608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9cdf458b-2563-44f7-a751-8381aaaf6f0a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:24.266963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9cdf458b-2563-44f7-a751-8381aaaf6f0a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:24.267426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9cdf458b-2563-44f7-a751-8381aaaf6f0a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:24.268175 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9cdf458b-2563-44f7-a751-8381aaaf6f0a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:24.268603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9cdf458b-2563-44f7-a751-8381aaaf6f0a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:24.308092 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4d7d20ed-35cd-4065-b911-25e3bbf07699 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:24.310360 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4d7d20ed-35cd-4065-b911-25e3bbf07699 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:24.317657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4d7d20ed-35cd-4065-b911-25e3bbf07699 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:24.319002 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4d7d20ed-35cd-4065-b911-25e3bbf07699 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:24.319976 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4d7d20ed-35cd-4065-b911-25e3bbf07699 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:24.320568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4d7d20ed-35cd-4065-b911-25e3bbf07699 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:24.451351 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9cdf458b-2563-44f7-a751-8381aaaf6f0a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:24.464762 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9cdf458b-2563-44f7-a751-8381aaaf6f0a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.208499 Jul 20 22:46:24.465775 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 82/163] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:24 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:24.502242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4d7d20ed-35cd-4065-b911-25e3bbf07699 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:24.510459 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4d7d20ed-35cd-4065-b911-25e3bbf07699 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.206676 Jul 20 22:46:24.511239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 82/164] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:24 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:24.529962 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d4cbd664-0c09-4bbf-827b-01614acaf2c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:24.532417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d4cbd664-0c09-4bbf-827b-01614acaf2c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:24.537859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d4cbd664-0c09-4bbf-827b-01614acaf2c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:24.538309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d4cbd664-0c09-4bbf-827b-01614acaf2c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:24.539125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d4cbd664-0c09-4bbf-827b-01614acaf2c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:24.539570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d4cbd664-0c09-4bbf-827b-01614acaf2c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:24.693504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d4cbd664-0c09-4bbf-827b-01614acaf2c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:24.701361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d4cbd664-0c09-4bbf-827b-01614acaf2c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.175184 Jul 20 22:46:24.702508 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 83/165] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:24 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:24.956826 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4751854f-c28f-4fdf-994a-cdc4347900b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:24.957429 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4751854f-c28f-4fdf-994a-cdc4347900b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:24.963436 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4751854f-c28f-4fdf-994a-cdc4347900b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:24.963883 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4751854f-c28f-4fdf-994a-cdc4347900b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:24.964643 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4751854f-c28f-4fdf-994a-cdc4347900b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:24.965074 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4751854f-c28f-4fdf-994a-cdc4347900b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:25.095878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4751854f-c28f-4fdf-994a-cdc4347900b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:25.103481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4751854f-c28f-4fdf-994a-cdc4347900b0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.150525 Jul 20 22:46:25.104061 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 83/166] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:24 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:25.481990 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-54b7252a-5b99-4f03-852a-88b5229ce117 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:25.482656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-54b7252a-5b99-4f03-852a-88b5229ce117 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:25.489701 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-54b7252a-5b99-4f03-852a-88b5229ce117 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:25.490451 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-54b7252a-5b99-4f03-852a-88b5229ce117 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:25.491492 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-54b7252a-5b99-4f03-852a-88b5229ce117 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:25.492151 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-54b7252a-5b99-4f03-852a-88b5229ce117 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:25.530791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2c160c28-0ec3-49a9-8707-af326a1009c8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:25.531449 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2c160c28-0ec3-49a9-8707-af326a1009c8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:25.538643 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2c160c28-0ec3-49a9-8707-af326a1009c8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:25.539123 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2c160c28-0ec3-49a9-8707-af326a1009c8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:25.539881 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2c160c28-0ec3-49a9-8707-af326a1009c8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:25.540307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2c160c28-0ec3-49a9-8707-af326a1009c8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:25.625498 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-54b7252a-5b99-4f03-852a-88b5229ce117 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:25.633258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-54b7252a-5b99-4f03-852a-88b5229ce117 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.155288 Jul 20 22:46:25.634190 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 84/167] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:25 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:25.675057 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2c160c28-0ec3-49a9-8707-af326a1009c8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:25.682462 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2c160c28-0ec3-49a9-8707-af326a1009c8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.156434 Jul 20 22:46:25.683291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 84/168] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:25 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:25.719619 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-da95bdc0-ee87-4416-b7aa-c2201efbda32 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:25.720228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-da95bdc0-ee87-4416-b7aa-c2201efbda32 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:25.726101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da95bdc0-ee87-4416-b7aa-c2201efbda32 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:25.726545 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da95bdc0-ee87-4416-b7aa-c2201efbda32 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:25.727415 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da95bdc0-ee87-4416-b7aa-c2201efbda32 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:25.728308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da95bdc0-ee87-4416-b7aa-c2201efbda32 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:25.858241 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-da95bdc0-ee87-4416-b7aa-c2201efbda32 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:25.868674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-da95bdc0-ee87-4416-b7aa-c2201efbda32 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.153211 Jul 20 22:46:25.869434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 85/169] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:25 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:26.120738 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1e832f08-1046-4b18-9242-f0f9afd590b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:26.121349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1e832f08-1046-4b18-9242-f0f9afd590b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:26.127448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1e832f08-1046-4b18-9242-f0f9afd590b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:26.127892 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1e832f08-1046-4b18-9242-f0f9afd590b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:26.128647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1e832f08-1046-4b18-9242-f0f9afd590b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:26.129149 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1e832f08-1046-4b18-9242-f0f9afd590b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:26.262199 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1e832f08-1046-4b18-9242-f0f9afd590b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:26.270571 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1e832f08-1046-4b18-9242-f0f9afd590b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.153640 Jul 20 22:46:26.271231 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 85/170] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:26 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:26.649486 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1a49d0b3-186a-494a-a8f7-5c684e7e6099 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:26.650708 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1a49d0b3-186a-494a-a8f7-5c684e7e6099 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:26.657302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a49d0b3-186a-494a-a8f7-5c684e7e6099 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:26.657827 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a49d0b3-186a-494a-a8f7-5c684e7e6099 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:26.658851 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a49d0b3-186a-494a-a8f7-5c684e7e6099 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:26.659325 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a49d0b3-186a-494a-a8f7-5c684e7e6099 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:26.699655 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e1802908-36ae-411d-b814-6fb320a5db10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:26.702854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e1802908-36ae-411d-b814-6fb320a5db10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:26.707276 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e1802908-36ae-411d-b814-6fb320a5db10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:26.707990 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e1802908-36ae-411d-b814-6fb320a5db10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:26.708821 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e1802908-36ae-411d-b814-6fb320a5db10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:26.709453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e1802908-36ae-411d-b814-6fb320a5db10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:26.805787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1a49d0b3-186a-494a-a8f7-5c684e7e6099 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:26.814191 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1a49d0b3-186a-494a-a8f7-5c684e7e6099 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.168382 Jul 20 22:46:26.818426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 86/171] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:26 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:26.854916 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e1802908-36ae-411d-b814-6fb320a5db10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:26.863309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e1802908-36ae-411d-b814-6fb320a5db10 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.167331 Jul 20 22:46:26.863877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 86/172] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:26 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:26.886168 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-db9cdd52-892e-48c5-a0b3-bb00b1fc1906 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:26.886944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-db9cdd52-892e-48c5-a0b3-bb00b1fc1906 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:26.894118 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-db9cdd52-892e-48c5-a0b3-bb00b1fc1906 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:26.894871 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-db9cdd52-892e-48c5-a0b3-bb00b1fc1906 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:26.895911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-db9cdd52-892e-48c5-a0b3-bb00b1fc1906 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:26.896545 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-db9cdd52-892e-48c5-a0b3-bb00b1fc1906 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:27.123955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-db9cdd52-892e-48c5-a0b3-bb00b1fc1906 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:27.131589 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-db9cdd52-892e-48c5-a0b3-bb00b1fc1906 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.249572 Jul 20 22:46:27.132265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 87/173] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:26 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:27.287942 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d1d5ac3b-9493-4023-925f-37b441b99ed5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:27.288549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d1d5ac3b-9493-4023-925f-37b441b99ed5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:27.294648 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1d5ac3b-9493-4023-925f-37b441b99ed5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:27.295115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1d5ac3b-9493-4023-925f-37b441b99ed5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:27.296490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1d5ac3b-9493-4023-925f-37b441b99ed5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:27.296922 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1d5ac3b-9493-4023-925f-37b441b99ed5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:27.426001 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d1d5ac3b-9493-4023-925f-37b441b99ed5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:27.433620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d1d5ac3b-9493-4023-925f-37b441b99ed5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.150171 Jul 20 22:46:27.434179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 87/174] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:27 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:27.830587 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-251dc753-1f68-4a06-bf84-7192d567a2b7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:27.831220 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-251dc753-1f68-4a06-bf84-7192d567a2b7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:27.837603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-251dc753-1f68-4a06-bf84-7192d567a2b7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:27.838439 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-251dc753-1f68-4a06-bf84-7192d567a2b7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:27.841807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-251dc753-1f68-4a06-bf84-7192d567a2b7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:27.841807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-251dc753-1f68-4a06-bf84-7192d567a2b7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:27.882589 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-34c5af01-0ced-40b1-baed-e394c049880f tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:27.883755 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-34c5af01-0ced-40b1-baed-e394c049880f tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:27.890344 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-34c5af01-0ced-40b1-baed-e394c049880f tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:27.890867 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-34c5af01-0ced-40b1-baed-e394c049880f tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:27.891738 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-34c5af01-0ced-40b1-baed-e394c049880f tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:27.892365 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-34c5af01-0ced-40b1-baed-e394c049880f tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:27.999966 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-251dc753-1f68-4a06-bf84-7192d567a2b7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:28.007370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-251dc753-1f68-4a06-bf84-7192d567a2b7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.180575 Jul 20 22:46:28.007937 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 88/175] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:27 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:28.048900 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-34c5af01-0ced-40b1-baed-e394c049880f tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:28.056282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-34c5af01-0ced-40b1-baed-e394c049880f tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.179419 Jul 20 22:46:28.056864 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 88/176] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:27 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:28.148234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-37532597-7437-42c1-b9b9-8ce52b537ade tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:28.148841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-37532597-7437-42c1-b9b9-8ce52b537ade tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:28.155364 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-37532597-7437-42c1-b9b9-8ce52b537ade tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:28.155831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-37532597-7437-42c1-b9b9-8ce52b537ade tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:28.156598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-37532597-7437-42c1-b9b9-8ce52b537ade tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:28.157030 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-37532597-7437-42c1-b9b9-8ce52b537ade tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:28.285138 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-37532597-7437-42c1-b9b9-8ce52b537ade tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:28.292594 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-37532597-7437-42c1-b9b9-8ce52b537ade tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.148080 Jul 20 22:46:28.293309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 89/177] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:28 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:28.449569 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e8d31045-002c-4e3e-9851-20c0b6f5dcd4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:28.450262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e8d31045-002c-4e3e-9851-20c0b6f5dcd4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:28.461174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8d31045-002c-4e3e-9851-20c0b6f5dcd4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:28.461616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8d31045-002c-4e3e-9851-20c0b6f5dcd4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:28.462406 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8d31045-002c-4e3e-9851-20c0b6f5dcd4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:28.462839 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8d31045-002c-4e3e-9851-20c0b6f5dcd4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:28.592227 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e8d31045-002c-4e3e-9851-20c0b6f5dcd4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:28.599635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e8d31045-002c-4e3e-9851-20c0b6f5dcd4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.154022 Jul 20 22:46:28.600234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 89/178] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:28 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:29.030830 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-996561d2-ac1e-4e29-97a3-5941fa077e1a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:29.031464 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-996561d2-ac1e-4e29-97a3-5941fa077e1a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:29.037674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-996561d2-ac1e-4e29-97a3-5941fa077e1a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:29.038118 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-996561d2-ac1e-4e29-97a3-5941fa077e1a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:29.038875 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-996561d2-ac1e-4e29-97a3-5941fa077e1a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:29.039338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-996561d2-ac1e-4e29-97a3-5941fa077e1a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:29.073086 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-58d01a08-7367-433a-9f9e-e709f4a643ea tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:29.073805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-58d01a08-7367-433a-9f9e-e709f4a643ea tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:29.080003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-58d01a08-7367-433a-9f9e-e709f4a643ea tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:29.080525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-58d01a08-7367-433a-9f9e-e709f4a643ea tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:29.081282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-58d01a08-7367-433a-9f9e-e709f4a643ea tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:29.081707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-58d01a08-7367-433a-9f9e-e709f4a643ea tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:29.166055 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-996561d2-ac1e-4e29-97a3-5941fa077e1a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:29.169491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:29.174277 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-996561d2-ac1e-4e29-97a3-5941fa077e1a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.147948 Jul 20 22:46:29.174860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 90/179] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:29 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:29.216049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-58d01a08-7367-433a-9f9e-e709f4a643ea tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:29.224131 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-58d01a08-7367-433a-9f9e-e709f4a643ea tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.154859 Jul 20 22:46:29.224688 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 90/180] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:29 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:29.309773 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4334ab5b-cad3-460c-a063-6ad0792ed78b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:29.310374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4334ab5b-cad3-460c-a063-6ad0792ed78b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:29.317010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4334ab5b-cad3-460c-a063-6ad0792ed78b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:29.317451 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4334ab5b-cad3-460c-a063-6ad0792ed78b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:29.318201 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4334ab5b-cad3-460c-a063-6ad0792ed78b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:29.318627 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4334ab5b-cad3-460c-a063-6ad0792ed78b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:29.446650 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4334ab5b-cad3-460c-a063-6ad0792ed78b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:29.454737 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4334ab5b-cad3-460c-a063-6ad0792ed78b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.149109 Jul 20 22:46:29.455330 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 91/181] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:29 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:29.616265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6dda5494-199d-4a36-943b-d25f0fbda5f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:29.616876 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6dda5494-199d-4a36-943b-d25f0fbda5f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:29.622795 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6dda5494-199d-4a36-943b-d25f0fbda5f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:29.623278 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6dda5494-199d-4a36-943b-d25f0fbda5f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:29.624030 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6dda5494-199d-4a36-943b-d25f0fbda5f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:29.624463 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6dda5494-199d-4a36-943b-d25f0fbda5f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:29.628336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:29.748262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6dda5494-199d-4a36-943b-d25f0fbda5f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:29.755679 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6dda5494-199d-4a36-943b-d25f0fbda5f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.143121 Jul 20 22:46:29.756243 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 91/182] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:29 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:30.191509 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ade01eae-0f10-4fa8-9562-10b80e22476c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:30.192146 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ade01eae-0f10-4fa8-9562-10b80e22476c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:30.198293 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ade01eae-0f10-4fa8-9562-10b80e22476c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:30.198727 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ade01eae-0f10-4fa8-9562-10b80e22476c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:30.199548 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ade01eae-0f10-4fa8-9562-10b80e22476c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:30.200011 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ade01eae-0f10-4fa8-9562-10b80e22476c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:30.240754 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-92d1bebd-7fb1-47d5-a3cd-bb3693039ab1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:30.241387 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-92d1bebd-7fb1-47d5-a3cd-bb3693039ab1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:30.247577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-92d1bebd-7fb1-47d5-a3cd-bb3693039ab1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:30.247945 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-92d1bebd-7fb1-47d5-a3cd-bb3693039ab1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:30.249179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-92d1bebd-7fb1-47d5-a3cd-bb3693039ab1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:30.249602 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-92d1bebd-7fb1-47d5-a3cd-bb3693039ab1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:30.328836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ade01eae-0f10-4fa8-9562-10b80e22476c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:30.336299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ade01eae-0f10-4fa8-9562-10b80e22476c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.148645 Jul 20 22:46:30.336887 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 92/183] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:30 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:30.377224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-92d1bebd-7fb1-47d5-a3cd-bb3693039ab1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:30.384605 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-92d1bebd-7fb1-47d5-a3cd-bb3693039ab1 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.147727 Jul 20 22:46:30.385167 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 92/184] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:30 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:30.472373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-815fc6de-7d18-429e-a2fa-a53eb0b3e9c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:30.473277 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-815fc6de-7d18-429e-a2fa-a53eb0b3e9c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:30.481847 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-815fc6de-7d18-429e-a2fa-a53eb0b3e9c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:30.482496 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-815fc6de-7d18-429e-a2fa-a53eb0b3e9c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:30.484191 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-815fc6de-7d18-429e-a2fa-a53eb0b3e9c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:30.484829 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-815fc6de-7d18-429e-a2fa-a53eb0b3e9c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:30.624024 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-815fc6de-7d18-429e-a2fa-a53eb0b3e9c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:30.631366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-815fc6de-7d18-429e-a2fa-a53eb0b3e9c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.164362 Jul 20 22:46:30.631930 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 93/185] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:30 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:30.772999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-698a19a0-ea11-4c67-82a9-d3815823e3b4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:30.773552 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-698a19a0-ea11-4c67-82a9-d3815823e3b4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:30.780055 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-698a19a0-ea11-4c67-82a9-d3815823e3b4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:30.780495 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-698a19a0-ea11-4c67-82a9-d3815823e3b4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:30.781237 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-698a19a0-ea11-4c67-82a9-d3815823e3b4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:30.781659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-698a19a0-ea11-4c67-82a9-d3815823e3b4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:30.910593 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-698a19a0-ea11-4c67-82a9-d3815823e3b4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:30.918048 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-698a19a0-ea11-4c67-82a9-d3815823e3b4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.148695 Jul 20 22:46:30.918396 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 93/186] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:30 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:31.352084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e2e3176c-9d7b-4e03-8c48-f5bb268d6a38 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:31.352691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e2e3176c-9d7b-4e03-8c48-f5bb268d6a38 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:31.358698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2e3176c-9d7b-4e03-8c48-f5bb268d6a38 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:31.359180 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2e3176c-9d7b-4e03-8c48-f5bb268d6a38 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:31.359973 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2e3176c-9d7b-4e03-8c48-f5bb268d6a38 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:31.360403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2e3176c-9d7b-4e03-8c48-f5bb268d6a38 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:31.400933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1ae0b45a-2640-4226-8254-2bced72eaae8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:31.401525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1ae0b45a-2640-4226-8254-2bced72eaae8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:31.408585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ae0b45a-2640-4226-8254-2bced72eaae8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:31.409026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ae0b45a-2640-4226-8254-2bced72eaae8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:31.409800 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ae0b45a-2640-4226-8254-2bced72eaae8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:31.410209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ae0b45a-2640-4226-8254-2bced72eaae8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:31.490322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e2e3176c-9d7b-4e03-8c48-f5bb268d6a38 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:31.497996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e2e3176c-9d7b-4e03-8c48-f5bb268d6a38 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.149722 Jul 20 22:46:31.499369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 94/187] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:31 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:31.542207 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1ae0b45a-2640-4226-8254-2bced72eaae8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:31.549657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1ae0b45a-2640-4226-8254-2bced72eaae8 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.152506 Jul 20 22:46:31.550221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 94/188] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:31 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:31.648011 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f4759780-8c0c-4df5-9d00-63ae18c6dbd5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:31.648790 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f4759780-8c0c-4df5-9d00-63ae18c6dbd5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:31.654775 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f4759780-8c0c-4df5-9d00-63ae18c6dbd5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:31.655240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f4759780-8c0c-4df5-9d00-63ae18c6dbd5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:31.655981 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f4759780-8c0c-4df5-9d00-63ae18c6dbd5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:31.656402 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f4759780-8c0c-4df5-9d00-63ae18c6dbd5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:31.933045 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f4759780-8c0c-4df5-9d00-63ae18c6dbd5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:31.934941 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-10175bc4-622f-4c6a-8a67-94bf910b40b1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:31.935570 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-10175bc4-622f-4c6a-8a67-94bf910b40b1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:31.941135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f4759780-8c0c-4df5-9d00-63ae18c6dbd5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.296886 Jul 20 22:46:31.941706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 95/189] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:31 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:31.942033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-10175bc4-622f-4c6a-8a67-94bf910b40b1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:31.942470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-10175bc4-622f-4c6a-8a67-94bf910b40b1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:31.943256 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-10175bc4-622f-4c6a-8a67-94bf910b40b1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:31.943692 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-10175bc4-622f-4c6a-8a67-94bf910b40b1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:32.077849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-10175bc4-622f-4c6a-8a67-94bf910b40b1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:32.085290 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-10175bc4-622f-4c6a-8a67-94bf910b40b1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.154400 Jul 20 22:46:32.085887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 95/190] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:31 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:32.530144 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e09f4675-b36a-4331-b503-2db719d50fdf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:32.530144 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e09f4675-b36a-4331-b503-2db719d50fdf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:32.530144 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e09f4675-b36a-4331-b503-2db719d50fdf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:32.530144 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e09f4675-b36a-4331-b503-2db719d50fdf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:32.531218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e09f4675-b36a-4331-b503-2db719d50fdf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:32.531218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e09f4675-b36a-4331-b503-2db719d50fdf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:32.565971 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a8b84f47-f3ad-49f5-b120-159b2dcd8aec tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:32.566749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a8b84f47-f3ad-49f5-b120-159b2dcd8aec tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:32.568610 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:32.573293 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a8b84f47-f3ad-49f5-b120-159b2dcd8aec tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:32.573732 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a8b84f47-f3ad-49f5-b120-159b2dcd8aec tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:32.574609 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a8b84f47-f3ad-49f5-b120-159b2dcd8aec tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:32.574919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a8b84f47-f3ad-49f5-b120-159b2dcd8aec tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:32.689495 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e09f4675-b36a-4331-b503-2db719d50fdf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:32.689495 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e09f4675-b36a-4331-b503-2db719d50fdf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.168954 Jul 20 22:46:32.689495 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 96/191] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:32 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:32.705712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a8b84f47-f3ad-49f5-b120-159b2dcd8aec tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:32.714153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a8b84f47-f3ad-49f5-b120-159b2dcd8aec tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.152018 Jul 20 22:46:32.714712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 96/192] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:32 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:32.959835 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-64c0be62-fa2d-4967-a242-e9d111971eaa tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:32.963774 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-64c0be62-fa2d-4967-a242-e9d111971eaa tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:32.966538 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64c0be62-fa2d-4967-a242-e9d111971eaa tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:32.966985 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64c0be62-fa2d-4967-a242-e9d111971eaa tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:32.967782 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64c0be62-fa2d-4967-a242-e9d111971eaa tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:32.968211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64c0be62-fa2d-4967-a242-e9d111971eaa tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:33.101756 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cb220ccb-3729-46e3-8c67-cb5ad39809f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:33.102417 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cb220ccb-3729-46e3-8c67-cb5ad39809f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:33.109413 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb220ccb-3729-46e3-8c67-cb5ad39809f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:33.109878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb220ccb-3729-46e3-8c67-cb5ad39809f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:33.110647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb220ccb-3729-46e3-8c67-cb5ad39809f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:33.111089 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb220ccb-3729-46e3-8c67-cb5ad39809f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:33.116188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-64c0be62-fa2d-4967-a242-e9d111971eaa tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:33.124979 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-64c0be62-fa2d-4967-a242-e9d111971eaa tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.169002 Jul 20 22:46:33.136585 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 97/193] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:32 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:33.158952 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-979d10a8-7bab-42dc-a137-6d235800e911 req-c32bb5d5-24a2-4c66-9dd2-8ab475ff12b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce8a500-8166-4cb3-bc33-41c35ef48651", "name": "network-vif-plugged", "status": "completed", "tag": "10d19aff-cf1c-4e78-abf5-f4fd95873ab9"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:33.170383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-979d10a8-7bab-42dc-a137-6d235800e911 req-c32bb5d5-24a2-4c66-9dd2-8ab475ff12b6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:33.170816 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-979d10a8-7bab-42dc-a137-6d235800e911 req-c32bb5d5-24a2-4c66-9dd2-8ab475ff12b6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:33.187875 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-979d10a8-7bab-42dc-a137-6d235800e911 req-c32bb5d5-24a2-4c66-9dd2-8ab475ff12b6 service nova] Creating event network-vif-plugged:10d19aff-cf1c-4e78-abf5-f4fd95873ab9 for instance cce8a500-8166-4cb3-bc33-41c35ef48651 on hv-cinder-79987 Jul 20 22:46:33.193729 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-979d10a8-7bab-42dc-a137-6d235800e911 req-c32bb5d5-24a2-4c66-9dd2-8ab475ff12b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040204 Jul 20 22:46:33.194581 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 98/194] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:46:33.250156 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cb220ccb-3729-46e3-8c67-cb5ad39809f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:33.258744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cb220ccb-3729-46e3-8c67-cb5ad39809f3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.159965 Jul 20 22:46:33.258744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 97/195] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:33 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:33.704655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-32d477ea-cbaa-4f7e-be74-1df6bad45557 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:33.705405 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-32d477ea-cbaa-4f7e-be74-1df6bad45557 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:33.712013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-32d477ea-cbaa-4f7e-be74-1df6bad45557 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:33.712525 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-32d477ea-cbaa-4f7e-be74-1df6bad45557 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:33.714234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-32d477ea-cbaa-4f7e-be74-1df6bad45557 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:33.714583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-32d477ea-cbaa-4f7e-be74-1df6bad45557 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:33.734898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fda20eae-403f-4a57-9221-4791bc0391aa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:33.736879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fda20eae-403f-4a57-9221-4791bc0391aa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:33.744153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fda20eae-403f-4a57-9221-4791bc0391aa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:33.744748 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fda20eae-403f-4a57-9221-4791bc0391aa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:33.745609 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fda20eae-403f-4a57-9221-4791bc0391aa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:33.746114 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fda20eae-403f-4a57-9221-4791bc0391aa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:33.854361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-32d477ea-cbaa-4f7e-be74-1df6bad45557 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:33.862416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-32d477ea-cbaa-4f7e-be74-1df6bad45557 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.161996 Jul 20 22:46:33.863436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 99/196] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:33 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:33.887955 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fda20eae-403f-4a57-9221-4791bc0391aa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:33.896938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fda20eae-403f-4a57-9221-4791bc0391aa tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.169350 Jul 20 22:46:33.897506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 98/197] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:33 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:34.143507 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-09e37969-53d8-43a0-ab02-d19858c58c4e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:34.144109 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-09e37969-53d8-43a0-ab02-d19858c58c4e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:34.150884 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09e37969-53d8-43a0-ab02-d19858c58c4e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:34.151357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09e37969-53d8-43a0-ab02-d19858c58c4e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:34.152116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09e37969-53d8-43a0-ab02-d19858c58c4e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:34.152541 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09e37969-53d8-43a0-ab02-d19858c58c4e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:34.275149 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-bb92b0ed-70fc-4464-b462-31bb119bc112 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:34.275865 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-bb92b0ed-70fc-4464-b462-31bb119bc112 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:34.285027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb92b0ed-70fc-4464-b462-31bb119bc112 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:34.285027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb92b0ed-70fc-4464-b462-31bb119bc112 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:34.285271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-09e37969-53d8-43a0-ab02-d19858c58c4e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:34.285382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb92b0ed-70fc-4464-b462-31bb119bc112 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:34.285382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb92b0ed-70fc-4464-b462-31bb119bc112 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:34.292177 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-09e37969-53d8-43a0-ab02-d19858c58c4e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.152400 Jul 20 22:46:34.292736 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 100/198] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:34 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:34.409774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-bb92b0ed-70fc-4464-b462-31bb119bc112 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:34.417183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-bb92b0ed-70fc-4464-b462-31bb119bc112 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.145825 Jul 20 22:46:34.417738 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 99/199] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:34 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:34.878257 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b47ffdc5-cbd2-4652-bfc2-a6636a7b46f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:34.878860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b47ffdc5-cbd2-4652-bfc2-a6636a7b46f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:34.884796 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b47ffdc5-cbd2-4652-bfc2-a6636a7b46f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:34.885240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b47ffdc5-cbd2-4652-bfc2-a6636a7b46f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:34.885990 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b47ffdc5-cbd2-4652-bfc2-a6636a7b46f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:34.886415 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b47ffdc5-cbd2-4652-bfc2-a6636a7b46f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:34.913717 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ca219eb2-4832-420c-8a30-2589f0ebf249 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:34.914323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ca219eb2-4832-420c-8a30-2589f0ebf249 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:34.920422 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ca219eb2-4832-420c-8a30-2589f0ebf249 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:34.920868 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ca219eb2-4832-420c-8a30-2589f0ebf249 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:34.921629 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ca219eb2-4832-420c-8a30-2589f0ebf249 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:34.922064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ca219eb2-4832-420c-8a30-2589f0ebf249 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:35.017544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b47ffdc5-cbd2-4652-bfc2-a6636a7b46f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:35.024976 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b47ffdc5-cbd2-4652-bfc2-a6636a7b46f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.150449 Jul 20 22:46:35.025546 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 101/200] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:34 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:35.052295 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ca219eb2-4832-420c-8a30-2589f0ebf249 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:35.059617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ca219eb2-4832-420c-8a30-2589f0ebf249 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.149667 Jul 20 22:46:35.060176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 100/201] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:34 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:35.308468 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7aa06421-e7fc-4388-b381-d1dcc8828ba8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:35.309069 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7aa06421-e7fc-4388-b381-d1dcc8828ba8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:35.315110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7aa06421-e7fc-4388-b381-d1dcc8828ba8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:35.315559 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7aa06421-e7fc-4388-b381-d1dcc8828ba8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:35.316317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7aa06421-e7fc-4388-b381-d1dcc8828ba8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:35.316752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7aa06421-e7fc-4388-b381-d1dcc8828ba8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:35.433959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-64b1c6c5-f255-4729-b337-a8354af33d25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:35.434633 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-64b1c6c5-f255-4729-b337-a8354af33d25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:35.440933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64b1c6c5-f255-4729-b337-a8354af33d25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:35.441229 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64b1c6c5-f255-4729-b337-a8354af33d25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:35.441983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64b1c6c5-f255-4729-b337-a8354af33d25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:35.442076 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7aa06421-e7fc-4388-b381-d1dcc8828ba8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:35.442418 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64b1c6c5-f255-4729-b337-a8354af33d25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:35.449357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7aa06421-e7fc-4388-b381-d1dcc8828ba8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.144659 Jul 20 22:46:35.449926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 102/202] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:35 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:35.566593 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-64b1c6c5-f255-4729-b337-a8354af33d25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:35.574006 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-64b1c6c5-f255-4729-b337-a8354af33d25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.143881 Jul 20 22:46:35.574567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 101/203] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:35 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:36.042150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-994aa65c-d7ee-4cab-b52b-ffc6e94a7438 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:36.042678 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-994aa65c-d7ee-4cab-b52b-ffc6e94a7438 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:36.048854 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-994aa65c-d7ee-4cab-b52b-ffc6e94a7438 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:36.049300 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-994aa65c-d7ee-4cab-b52b-ffc6e94a7438 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:36.050054 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-994aa65c-d7ee-4cab-b52b-ffc6e94a7438 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:36.050487 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-994aa65c-d7ee-4cab-b52b-ffc6e94a7438 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:36.077515 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-078d2119-1f57-4a9d-9593-96bca5641bcf tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:36.078117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-078d2119-1f57-4a9d-9593-96bca5641bcf tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:36.084073 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-078d2119-1f57-4a9d-9593-96bca5641bcf tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:36.084514 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-078d2119-1f57-4a9d-9593-96bca5641bcf tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:36.085269 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-078d2119-1f57-4a9d-9593-96bca5641bcf tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:36.085695 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-078d2119-1f57-4a9d-9593-96bca5641bcf tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:36.195583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-994aa65c-d7ee-4cab-b52b-ffc6e94a7438 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:36.208884 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-994aa65c-d7ee-4cab-b52b-ffc6e94a7438 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.169254 Jul 20 22:46:36.217342 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 103/204] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:36 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:36.229624 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-078d2119-1f57-4a9d-9593-96bca5641bcf tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:36.239619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-078d2119-1f57-4a9d-9593-96bca5641bcf tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.166522 Jul 20 22:46:36.240195 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 102/205] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:36 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:36.465460 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3d88e505-1cd2-4bc2-8c4c-0905f902ad48 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:36.466051 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3d88e505-1cd2-4bc2-8c4c-0905f902ad48 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:36.472031 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3d88e505-1cd2-4bc2-8c4c-0905f902ad48 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:36.472471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3d88e505-1cd2-4bc2-8c4c-0905f902ad48 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:36.473214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3d88e505-1cd2-4bc2-8c4c-0905f902ad48 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:36.473640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3d88e505-1cd2-4bc2-8c4c-0905f902ad48 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:36.590936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-64419ac4-61b1-4848-ac68-49a0895d79c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:36.594559 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-64419ac4-61b1-4848-ac68-49a0895d79c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:36.597493 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64419ac4-61b1-4848-ac68-49a0895d79c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:36.597927 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64419ac4-61b1-4848-ac68-49a0895d79c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:36.598678 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64419ac4-61b1-4848-ac68-49a0895d79c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:36.599138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64419ac4-61b1-4848-ac68-49a0895d79c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:36.599239 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3d88e505-1cd2-4bc2-8c4c-0905f902ad48 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:36.607174 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3d88e505-1cd2-4bc2-8c4c-0905f902ad48 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.145480 Jul 20 22:46:36.608266 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 104/206] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:36 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:36.726741 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-64419ac4-61b1-4848-ac68-49a0895d79c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:36.736934 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-64419ac4-61b1-4848-ac68-49a0895d79c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.148189 Jul 20 22:46:36.736934 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 103/207] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:36 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:37.224312 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8ebe5c10-8ba5-4adf-8af0-b8286f6d9808 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:37.224953 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8ebe5c10-8ba5-4adf-8af0-b8286f6d9808 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:37.231037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8ebe5c10-8ba5-4adf-8af0-b8286f6d9808 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:37.231480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8ebe5c10-8ba5-4adf-8af0-b8286f6d9808 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:37.232272 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8ebe5c10-8ba5-4adf-8af0-b8286f6d9808 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:37.233194 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8ebe5c10-8ba5-4adf-8af0-b8286f6d9808 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:37.260103 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e126d5c6-f81f-4ba4-af09-8aba31180e9a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:37.261018 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e126d5c6-f81f-4ba4-af09-8aba31180e9a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:37.267435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e126d5c6-f81f-4ba4-af09-8aba31180e9a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:37.267871 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e126d5c6-f81f-4ba4-af09-8aba31180e9a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:37.268646 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e126d5c6-f81f-4ba4-af09-8aba31180e9a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:37.269187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e126d5c6-f81f-4ba4-af09-8aba31180e9a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:37.365727 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8ebe5c10-8ba5-4adf-8af0-b8286f6d9808 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:37.373699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8ebe5c10-8ba5-4adf-8af0-b8286f6d9808 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.152617 Jul 20 22:46:37.374268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 105/208] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:37 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:37.401475 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e126d5c6-f81f-4ba4-af09-8aba31180e9a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:37.409102 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e126d5c6-f81f-4ba4-af09-8aba31180e9a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.152968 Jul 20 22:46:37.409729 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 104/209] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:37 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:37.624568 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c707c9f4-9160-402d-a6b7-bb49d31e3796 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:37.625231 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c707c9f4-9160-402d-a6b7-bb49d31e3796 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:37.631185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c707c9f4-9160-402d-a6b7-bb49d31e3796 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:37.631630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c707c9f4-9160-402d-a6b7-bb49d31e3796 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:37.632384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c707c9f4-9160-402d-a6b7-bb49d31e3796 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:37.632816 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c707c9f4-9160-402d-a6b7-bb49d31e3796 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:37.752716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-67ea0e52-0318-4ecd-ba0d-e7156ca5eceb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:37.753175 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-67ea0e52-0318-4ecd-ba0d-e7156ca5eceb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:37.760457 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c707c9f4-9160-402d-a6b7-bb49d31e3796 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:37.770697 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67ea0e52-0318-4ecd-ba0d-e7156ca5eceb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:37.774936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67ea0e52-0318-4ecd-ba0d-e7156ca5eceb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:37.774936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67ea0e52-0318-4ecd-ba0d-e7156ca5eceb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:37.774936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67ea0e52-0318-4ecd-ba0d-e7156ca5eceb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:37.775261 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c707c9f4-9160-402d-a6b7-bb49d31e3796 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.148292 Jul 20 22:46:37.775356 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 106/210] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:37 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:37.904983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-67ea0e52-0318-4ecd-ba0d-e7156ca5eceb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:37.912490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-67ea0e52-0318-4ecd-ba0d-e7156ca5eceb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.163973 Jul 20 22:46:37.913095 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 105/211] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:37 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:38.391157 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c7bcad8a-5468-4682-b9c9-c8b8ce6e657e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:38.391758 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c7bcad8a-5468-4682-b9c9-c8b8ce6e657e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:38.397859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7bcad8a-5468-4682-b9c9-c8b8ce6e657e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:38.398306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7bcad8a-5468-4682-b9c9-c8b8ce6e657e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:38.399084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7bcad8a-5468-4682-b9c9-c8b8ce6e657e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:38.399555 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7bcad8a-5468-4682-b9c9-c8b8ce6e657e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:38.425630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5d5d577a-dc3e-4ed4-979b-f5dfc6995475 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:38.426302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-5d5d577a-dc3e-4ed4-979b-f5dfc6995475 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:38.432512 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d5d577a-dc3e-4ed4-979b-f5dfc6995475 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:38.432949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d5d577a-dc3e-4ed4-979b-f5dfc6995475 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:38.433733 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d5d577a-dc3e-4ed4-979b-f5dfc6995475 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:38.434183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d5d577a-dc3e-4ed4-979b-f5dfc6995475 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:38.527949 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c7bcad8a-5468-4682-b9c9-c8b8ce6e657e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:38.535746 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c7bcad8a-5468-4682-b9c9-c8b8ce6e657e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.149081 Jul 20 22:46:38.549338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 107/212] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:38 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:38.563580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-5d5d577a-dc3e-4ed4-979b-f5dfc6995475 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:38.570920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5d5d577a-dc3e-4ed4-979b-f5dfc6995475 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.149164 Jul 20 22:46:38.580561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 106/213] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:38 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:38.792613 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e828704d-09f3-40bb-abd7-e45998ac8a26 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:38.793218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e828704d-09f3-40bb-abd7-e45998ac8a26 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:38.799193 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e828704d-09f3-40bb-abd7-e45998ac8a26 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:38.799644 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e828704d-09f3-40bb-abd7-e45998ac8a26 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:38.800467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e828704d-09f3-40bb-abd7-e45998ac8a26 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:38.800903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e828704d-09f3-40bb-abd7-e45998ac8a26 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:38.805980 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:38.933827 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1dd660a2-e103-48d8-826a-36a5331cb84c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:38.934584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1dd660a2-e103-48d8-826a-36a5331cb84c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:38.941322 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1dd660a2-e103-48d8-826a-36a5331cb84c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:38.941907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1dd660a2-e103-48d8-826a-36a5331cb84c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:38.942677 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1dd660a2-e103-48d8-826a-36a5331cb84c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:38.943132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1dd660a2-e103-48d8-826a-36a5331cb84c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:38.944251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e828704d-09f3-40bb-abd7-e45998ac8a26 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:38.962384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e828704d-09f3-40bb-abd7-e45998ac8a26 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.173254 Jul 20 22:46:38.963897 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 108/214] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:38 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:39.085182 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1dd660a2-e103-48d8-826a-36a5331cb84c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:39.088728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:39.093701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1dd660a2-e103-48d8-826a-36a5331cb84c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.167815 Jul 20 22:46:39.094262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 107/215] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:38 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:39.552808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f8901018-5ba6-4e85-8700-15fb4079ce33 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:39.553408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f8901018-5ba6-4e85-8700-15fb4079ce33 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:39.560988 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f8901018-5ba6-4e85-8700-15fb4079ce33 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:39.561461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f8901018-5ba6-4e85-8700-15fb4079ce33 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:39.562253 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f8901018-5ba6-4e85-8700-15fb4079ce33 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:39.562680 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f8901018-5ba6-4e85-8700-15fb4079ce33 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:39.597392 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d1552ecb-5904-4148-b264-0017c4fc44d3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:39.598098 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d1552ecb-5904-4148-b264-0017c4fc44d3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:39.604555 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1552ecb-5904-4148-b264-0017c4fc44d3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:39.606117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1552ecb-5904-4148-b264-0017c4fc44d3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:39.606117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1552ecb-5904-4148-b264-0017c4fc44d3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:39.606747 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1552ecb-5904-4148-b264-0017c4fc44d3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:39.702372 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f8901018-5ba6-4e85-8700-15fb4079ce33 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:39.711517 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f8901018-5ba6-4e85-8700-15fb4079ce33 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.162289 Jul 20 22:46:39.712094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 109/216] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:39 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:39.755215 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d1552ecb-5904-4148-b264-0017c4fc44d3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:39.762775 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d1552ecb-5904-4148-b264-0017c4fc44d3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.171286 Jul 20 22:46:39.763363 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 108/217] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:39 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:39.989409 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c29a8023-7d4d-4e51-b32b-64659e8e1cc2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:39.990018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c29a8023-7d4d-4e51-b32b-64659e8e1cc2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:39.996317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c29a8023-7d4d-4e51-b32b-64659e8e1cc2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:39.996467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c29a8023-7d4d-4e51-b32b-64659e8e1cc2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:39.997213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c29a8023-7d4d-4e51-b32b-64659e8e1cc2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:39.997643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c29a8023-7d4d-4e51-b32b-64659e8e1cc2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:40.110779 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2a5b56ea-1007-4032-929e-9ee6c6ffce2e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:40.111536 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2a5b56ea-1007-4032-929e-9ee6c6ffce2e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:40.117808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2a5b56ea-1007-4032-929e-9ee6c6ffce2e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:40.118277 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2a5b56ea-1007-4032-929e-9ee6c6ffce2e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:40.119052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2a5b56ea-1007-4032-929e-9ee6c6ffce2e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:40.119491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2a5b56ea-1007-4032-929e-9ee6c6ffce2e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:40.259352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2a5b56ea-1007-4032-929e-9ee6c6ffce2e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:40.268216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2a5b56ea-1007-4032-929e-9ee6c6ffce2e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.161150 Jul 20 22:46:40.268842 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 109/218] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:40 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:40.300488 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c29a8023-7d4d-4e51-b32b-64659e8e1cc2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:40.308030 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c29a8023-7d4d-4e51-b32b-64659e8e1cc2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.322478 Jul 20 22:46:40.308612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 110/219] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:39 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:40.727958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-529da513-cd81-4702-b14a-b298f17a17c8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:40.728562 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-529da513-cd81-4702-b14a-b298f17a17c8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:40.735027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-529da513-cd81-4702-b14a-b298f17a17c8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:40.735488 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-529da513-cd81-4702-b14a-b298f17a17c8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:40.736240 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-529da513-cd81-4702-b14a-b298f17a17c8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:40.736673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-529da513-cd81-4702-b14a-b298f17a17c8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:40.780105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-64c300d2-6ad3-499f-8402-89a5ddb7ec6b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:40.780737 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-64c300d2-6ad3-499f-8402-89a5ddb7ec6b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:40.787228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64c300d2-6ad3-499f-8402-89a5ddb7ec6b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:40.787676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64c300d2-6ad3-499f-8402-89a5ddb7ec6b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:40.788435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64c300d2-6ad3-499f-8402-89a5ddb7ec6b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:40.788867 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-64c300d2-6ad3-499f-8402-89a5ddb7ec6b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:40.864698 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-529da513-cd81-4702-b14a-b298f17a17c8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:40.872080 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-529da513-cd81-4702-b14a-b298f17a17c8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.147891 Jul 20 22:46:40.872632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 110/220] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:40 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:40.918781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-64c300d2-6ad3-499f-8402-89a5ddb7ec6b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:40.926566 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-64c300d2-6ad3-499f-8402-89a5ddb7ec6b tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.150310 Jul 20 22:46:40.927153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 111/221] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:40 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:41.285281 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-74450528-acf0-4dd5-9891-1dfaf98f1187 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:41.285907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-74450528-acf0-4dd5-9891-1dfaf98f1187 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:41.291948 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-74450528-acf0-4dd5-9891-1dfaf98f1187 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:41.292386 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-74450528-acf0-4dd5-9891-1dfaf98f1187 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:41.293122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-74450528-acf0-4dd5-9891-1dfaf98f1187 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:41.293546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-74450528-acf0-4dd5-9891-1dfaf98f1187 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:41.325129 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6cc91deb-de2e-40dd-8de8-cab4baea30f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:41.325732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6cc91deb-de2e-40dd-8de8-cab4baea30f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:41.331962 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6cc91deb-de2e-40dd-8de8-cab4baea30f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:41.332412 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6cc91deb-de2e-40dd-8de8-cab4baea30f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:41.333170 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6cc91deb-de2e-40dd-8de8-cab4baea30f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:41.333600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6cc91deb-de2e-40dd-8de8-cab4baea30f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:41.422350 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-74450528-acf0-4dd5-9891-1dfaf98f1187 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:41.431027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-74450528-acf0-4dd5-9891-1dfaf98f1187 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.149686 Jul 20 22:46:41.438556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 111/222] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:41 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:41.473592 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6cc91deb-de2e-40dd-8de8-cab4baea30f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:41.481137 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6cc91deb-de2e-40dd-8de8-cab4baea30f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.159784 Jul 20 22:46:41.481694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 112/223] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:41 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:41.889774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d5bc5d6c-668c-4b68-b264-593d98b8c264 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:41.890368 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d5bc5d6c-668c-4b68-b264-593d98b8c264 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:41.896341 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d6c-668c-4b68-b264-593d98b8c264 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:41.896808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d6c-668c-4b68-b264-593d98b8c264 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:41.897547 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d6c-668c-4b68-b264-593d98b8c264 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:41.897974 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5bc5d6c-668c-4b68-b264-593d98b8c264 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:41.943963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b33b7ac3-a878-4e09-8d82-f2b87589c1fc tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:41.944569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b33b7ac3-a878-4e09-8d82-f2b87589c1fc tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:41.950518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b33b7ac3-a878-4e09-8d82-f2b87589c1fc tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:41.951716 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b33b7ac3-a878-4e09-8d82-f2b87589c1fc tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:41.952389 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b33b7ac3-a878-4e09-8d82-f2b87589c1fc tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:41.952841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b33b7ac3-a878-4e09-8d82-f2b87589c1fc tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:42.030489 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d5bc5d6c-668c-4b68-b264-593d98b8c264 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:42.038402 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d5bc5d6c-668c-4b68-b264-593d98b8c264 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.153082 Jul 20 22:46:42.040056 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 112/224] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:41 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:42.082779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b33b7ac3-a878-4e09-8d82-f2b87589c1fc tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:42.090319 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b33b7ac3-a878-4e09-8d82-f2b87589c1fc tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.150425 Jul 20 22:46:42.090989 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 113/225] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:41 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:42.448328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-edcad8ee-6958-4b89-9f41-81a93d7000f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:42.448934 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-edcad8ee-6958-4b89-9f41-81a93d7000f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:42.455413 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-edcad8ee-6958-4b89-9f41-81a93d7000f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:42.455859 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-edcad8ee-6958-4b89-9f41-81a93d7000f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:42.456613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-edcad8ee-6958-4b89-9f41-81a93d7000f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:42.457042 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-edcad8ee-6958-4b89-9f41-81a93d7000f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:42.498021 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c863db70-e092-41f2-b9ee-680c33313eb7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:42.498895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c863db70-e092-41f2-b9ee-680c33313eb7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:42.505303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c863db70-e092-41f2-b9ee-680c33313eb7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:42.505859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c863db70-e092-41f2-b9ee-680c33313eb7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:42.506726 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c863db70-e092-41f2-b9ee-680c33313eb7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:42.507268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c863db70-e092-41f2-b9ee-680c33313eb7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:42.586834 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-edcad8ee-6958-4b89-9f41-81a93d7000f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:42.594865 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-edcad8ee-6958-4b89-9f41-81a93d7000f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.150318 Jul 20 22:46:42.604079 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 113/226] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:42 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:42.639388 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c863db70-e092-41f2-b9ee-680c33313eb7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:42.646928 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c863db70-e092-41f2-b9ee-680c33313eb7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.153236 Jul 20 22:46:42.651968 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 114/227] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:42 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:43.055986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-317d779f-3c22-425b-b163-b88cd868d552 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:43.056590 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-317d779f-3c22-425b-b163-b88cd868d552 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:43.064806 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-317d779f-3c22-425b-b163-b88cd868d552 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:43.065673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-317d779f-3c22-425b-b163-b88cd868d552 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:43.066453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-317d779f-3c22-425b-b163-b88cd868d552 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:43.066913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-317d779f-3c22-425b-b163-b88cd868d552 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:43.106994 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6e27d958-fbf4-485d-9d32-6ad3a970548d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:43.107641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6e27d958-fbf4-485d-9d32-6ad3a970548d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:43.114156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e27d958-fbf4-485d-9d32-6ad3a970548d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:43.114831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e27d958-fbf4-485d-9d32-6ad3a970548d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:43.115805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e27d958-fbf4-485d-9d32-6ad3a970548d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:43.116426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e27d958-fbf4-485d-9d32-6ad3a970548d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:43.220556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-317d779f-3c22-425b-b163-b88cd868d552 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:43.231351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-317d779f-3c22-425b-b163-b88cd868d552 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1321 microversion: 2.1 time: 0.179098 Jul 20 22:46:43.231931 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 114/228] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:43 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:43.291398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6e27d958-fbf4-485d-9d32-6ad3a970548d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:43.299520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6e27d958-fbf4-485d-9d32-6ad3a970548d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.196255 Jul 20 22:46:43.300092 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 115/229] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:43 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:43.612473 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c079d343-1c37-4346-8316-0cec6a4b2279 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:43.613075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c079d343-1c37-4346-8316-0cec6a4b2279 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:43.619274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c079d343-1c37-4346-8316-0cec6a4b2279 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:43.620004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c079d343-1c37-4346-8316-0cec6a4b2279 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:43.620697 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c079d343-1c37-4346-8316-0cec6a4b2279 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:43.621484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c079d343-1c37-4346-8316-0cec6a4b2279 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:43.666449 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1fe78339-55b0-478e-9c8d-1c562c6f53ff tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:43.667194 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1fe78339-55b0-478e-9c8d-1c562c6f53ff tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:43.673923 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1fe78339-55b0-478e-9c8d-1c562c6f53ff tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:43.674403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1fe78339-55b0-478e-9c8d-1c562c6f53ff tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:43.675197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1fe78339-55b0-478e-9c8d-1c562c6f53ff tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:43.675634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1fe78339-55b0-478e-9c8d-1c562c6f53ff tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:43.752664 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c079d343-1c37-4346-8316-0cec6a4b2279 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:43.760740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c079d343-1c37-4346-8316-0cec6a4b2279 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.152162 Jul 20 22:46:43.761683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 115/230] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:43 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:43.820376 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1fe78339-55b0-478e-9c8d-1c562c6f53ff tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:43.828307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1fe78339-55b0-478e-9c8d-1c562c6f53ff tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.165628 Jul 20 22:46:43.828885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 116/231] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:43 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:44.249764 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-bc1c7b83-4877-4be6-9a48-44f74ed9789e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:44.250369 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-bc1c7b83-4877-4be6-9a48-44f74ed9789e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:44.256312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bc1c7b83-4877-4be6-9a48-44f74ed9789e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.261176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bc1c7b83-4877-4be6-9a48-44f74ed9789e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.261176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bc1c7b83-4877-4be6-9a48-44f74ed9789e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.261176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bc1c7b83-4877-4be6-9a48-44f74ed9789e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.316806 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-786cc0c9-91f9-420c-b8ce-6c42e048dbc7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:44.317415 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-786cc0c9-91f9-420c-b8ce-6c42e048dbc7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:44.324244 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-786cc0c9-91f9-420c-b8ce-6c42e048dbc7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.325386 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-786cc0c9-91f9-420c-b8ce-6c42e048dbc7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.326771 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-786cc0c9-91f9-420c-b8ce-6c42e048dbc7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.329815 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-786cc0c9-91f9-420c-b8ce-6c42e048dbc7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.397249 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-bc1c7b83-4877-4be6-9a48-44f74ed9789e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:44.405215 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-bc1c7b83-4877-4be6-9a48-44f74ed9789e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1514 microversion: 2.1 time: 0.159184 Jul 20 22:46:44.405850 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 116/232] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:44 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:44.428911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-147c0b65-e9bb-4b31-b078-fb695a36d829 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:44.429924 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-147c0b65-e9bb-4b31-b078-fb695a36d829 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:44.437018 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-147c0b65-e9bb-4b31-b078-fb695a36d829 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.437463 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-147c0b65-e9bb-4b31-b078-fb695a36d829 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.438378 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-147c0b65-e9bb-4b31-b078-fb695a36d829 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.438811 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-147c0b65-e9bb-4b31-b078-fb695a36d829 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.473867 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-786cc0c9-91f9-420c-b8ce-6c42e048dbc7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:44.480590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-786cc0c9-91f9-420c-b8ce-6c42e048dbc7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.167708 Jul 20 22:46:44.481266 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 117/233] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:44 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:44.501362 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-147c0b65-e9bb-4b31-b078-fb695a36d829 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lazy-loading 'flavor' on Instance uuid bd16033e-a51a-43c6-9926-7d4fc9b96bd1 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:46:44.782259 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-41b74793-aeff-4f6d-bb57-c1a8ce7e78c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:44.788453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-41b74793-aeff-4f6d-bb57-c1a8ce7e78c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:44.789488 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41b74793-aeff-4f6d-bb57-c1a8ce7e78c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.789940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41b74793-aeff-4f6d-bb57-c1a8ce7e78c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.790707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41b74793-aeff-4f6d-bb57-c1a8ce7e78c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.791172 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41b74793-aeff-4f6d-bb57-c1a8ce7e78c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.921667 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-41b74793-aeff-4f6d-bb57-c1a8ce7e78c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:44.929039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-41b74793-aeff-4f6d-bb57-c1a8ce7e78c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.154540 Jul 20 22:46:44.929601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 118/234] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:44 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:44.933916 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a108ffa7-a58f-4a23-84f9-17bb86adbcec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:44.934518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a108ffa7-a58f-4a23-84f9-17bb86adbcec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:44.940123 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a108ffa7-a58f-4a23-84f9-17bb86adbcec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.940678 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a108ffa7-a58f-4a23-84f9-17bb86adbcec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.941441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a108ffa7-a58f-4a23-84f9-17bb86adbcec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.941883 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a108ffa7-a58f-4a23-84f9-17bb86adbcec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.949278 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-147c0b65-e9bb-4b31-b078-fb695a36d829 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1/action" status: 200 len: 32 microversion: 2.1 time: 0.524358 Jul 20 22:46:44.954311 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 117/235] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:46:44 2022] POST /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1/action => generated 32 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 22:46:44.962085 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-67d0866d-90cf-465a-a619-2ac00758b6d1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:44.962755 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-67d0866d-90cf-465a-a619-2ac00758b6d1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:44.969641 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67d0866d-90cf-465a-a619-2ac00758b6d1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.970087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67d0866d-90cf-465a-a619-2ac00758b6d1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:44.970844 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67d0866d-90cf-465a-a619-2ac00758b6d1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:44.971309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67d0866d-90cf-465a-a619-2ac00758b6d1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:45.085614 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a108ffa7-a58f-4a23-84f9-17bb86adbcec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:45.094785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a108ffa7-a58f-4a23-84f9-17bb86adbcec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.164181 Jul 20 22:46:45.095606 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 119/236] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:44 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:45.117585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-67d0866d-90cf-465a-a619-2ac00758b6d1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:45.125466 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-67d0866d-90cf-465a-a619-2ac00758b6d1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.167218 Jul 20 22:46:45.125970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 118/237] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:44 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:45.497371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c44f8b7b-6e6a-440f-bc34-100c310740c5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:45.498551 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c44f8b7b-6e6a-440f-bc34-100c310740c5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:45.504649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c44f8b7b-6e6a-440f-bc34-100c310740c5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:45.505097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c44f8b7b-6e6a-440f-bc34-100c310740c5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:45.505858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c44f8b7b-6e6a-440f-bc34-100c310740c5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:45.506287 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c44f8b7b-6e6a-440f-bc34-100c310740c5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:45.640708 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c44f8b7b-6e6a-440f-bc34-100c310740c5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:45.648127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c44f8b7b-6e6a-440f-bc34-100c310740c5 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.154126 Jul 20 22:46:45.663043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 120/238] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:45 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:45.720578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-e4ced109-c880-4a31-82ed-4848c31aaf06 req-ad38779d-14cd-4830-beb9-1cd00e79236f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed11a51a-3574-43eb-a485-e6df2ded9fee", "name": "network-vif-plugged", "status": "completed", "tag": "f1feda7d-23f5-45c6-aa8d-8ed0915aa1ec"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:45.728976 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-e4ced109-c880-4a31-82ed-4848c31aaf06 req-ad38779d-14cd-4830-beb9-1cd00e79236f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:45.729407 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-e4ced109-c880-4a31-82ed-4848c31aaf06 req-ad38779d-14cd-4830-beb9-1cd00e79236f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:45.740274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-e4ced109-c880-4a31-82ed-4848c31aaf06 req-ad38779d-14cd-4830-beb9-1cd00e79236f service nova] Creating event network-vif-plugged:f1feda7d-23f5-45c6-aa8d-8ed0915aa1ec for instance ed11a51a-3574-43eb-a485-e6df2ded9fee on hv-cinder-79987 Jul 20 22:46:45.753277 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-e4ced109-c880-4a31-82ed-4848c31aaf06 req-ad38779d-14cd-4830-beb9-1cd00e79236f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028368 Jul 20 22:46:45.753277 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 119/239] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:46:45.947430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ffc07c35-9229-4cda-9ac1-fc67dfe2f495 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:45.947430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ffc07c35-9229-4cda-9ac1-fc67dfe2f495 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:45.953676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffc07c35-9229-4cda-9ac1-fc67dfe2f495 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:45.953676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffc07c35-9229-4cda-9ac1-fc67dfe2f495 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:45.954666 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffc07c35-9229-4cda-9ac1-fc67dfe2f495 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:45.955306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffc07c35-9229-4cda-9ac1-fc67dfe2f495 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:46.112636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1428aecc-81b3-4f1c-9982-994fd0e6791d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:46.113324 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1428aecc-81b3-4f1c-9982-994fd0e6791d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:46.119898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1428aecc-81b3-4f1c-9982-994fd0e6791d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:46.126499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1428aecc-81b3-4f1c-9982-994fd0e6791d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:46.126499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1428aecc-81b3-4f1c-9982-994fd0e6791d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:46.126499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1428aecc-81b3-4f1c-9982-994fd0e6791d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:46.156715 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ffc07c35-9229-4cda-9ac1-fc67dfe2f495 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:46.164554 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ffc07c35-9229-4cda-9ac1-fc67dfe2f495 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.222642 Jul 20 22:46:46.165171 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 121/240] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:45 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:46.170522 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2a5ccc13-245b-46b8-ad82-7a708004b266 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:46.171381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2a5ccc13-245b-46b8-ad82-7a708004b266 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:46.179435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2a5ccc13-245b-46b8-ad82-7a708004b266 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:46.179892 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2a5ccc13-245b-46b8-ad82-7a708004b266 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:46.180698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2a5ccc13-245b-46b8-ad82-7a708004b266 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:46.181134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2a5ccc13-245b-46b8-ad82-7a708004b266 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:46.288799 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1428aecc-81b3-4f1c-9982-994fd0e6791d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:46.299709 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1428aecc-81b3-4f1c-9982-994fd0e6791d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.191054 Jul 20 22:46:46.300297 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 120/241] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:46 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:46.319535 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2a5ccc13-245b-46b8-ad82-7a708004b266 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:46.327673 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2a5ccc13-245b-46b8-ad82-7a708004b266 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.161059 Jul 20 22:46:46.328247 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 122/242] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:46 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:46.673733 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-06e01370-da5f-46fc-bd71-b54379af047e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:46.674314 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-06e01370-da5f-46fc-bd71-b54379af047e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:46.680433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-06e01370-da5f-46fc-bd71-b54379af047e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:46.680874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-06e01370-da5f-46fc-bd71-b54379af047e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:46.681623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-06e01370-da5f-46fc-bd71-b54379af047e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:46.682046 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-06e01370-da5f-46fc-bd71-b54379af047e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:46.855306 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-06e01370-da5f-46fc-bd71-b54379af047e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:46.862498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-06e01370-da5f-46fc-bd71-b54379af047e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.192756 Jul 20 22:46:46.863352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 121/243] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:46 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:47.186682 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7e0f6562-c4c0-4d03-8166-9c745fb11506 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:47.187318 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7e0f6562-c4c0-4d03-8166-9c745fb11506 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:47.193448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7e0f6562-c4c0-4d03-8166-9c745fb11506 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:47.194095 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7e0f6562-c4c0-4d03-8166-9c745fb11506 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:47.196303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7e0f6562-c4c0-4d03-8166-9c745fb11506 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:47.205504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7e0f6562-c4c0-4d03-8166-9c745fb11506 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:47.317895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0bb4d9ea-da73-437f-a04e-3164613fcb5a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:47.318578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0bb4d9ea-da73-437f-a04e-3164613fcb5a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:47.325004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0bb4d9ea-da73-437f-a04e-3164613fcb5a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:47.325732 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0bb4d9ea-da73-437f-a04e-3164613fcb5a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:47.326568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0bb4d9ea-da73-437f-a04e-3164613fcb5a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:47.330840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0bb4d9ea-da73-437f-a04e-3164613fcb5a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:47.354024 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7e0f6562-c4c0-4d03-8166-9c745fb11506 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:47.362314 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7e0f6562-c4c0-4d03-8166-9c745fb11506 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.184283 Jul 20 22:46:47.364145 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 123/244] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:47 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:47.375661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c88fb496-79c3-4cef-b546-dec35add40c6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:47.375661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c88fb496-79c3-4cef-b546-dec35add40c6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:47.375661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c88fb496-79c3-4cef-b546-dec35add40c6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:47.375661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c88fb496-79c3-4cef-b546-dec35add40c6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:47.376189 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c88fb496-79c3-4cef-b546-dec35add40c6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:47.376308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c88fb496-79c3-4cef-b546-dec35add40c6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:47.518079 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c88fb496-79c3-4cef-b546-dec35add40c6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:47.521590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:47.526281 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c88fb496-79c3-4cef-b546-dec35add40c6 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.162418 Jul 20 22:46:47.526853 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 124/245] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:47 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:47.539914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0bb4d9ea-da73-437f-a04e-3164613fcb5a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:47.547376 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0bb4d9ea-da73-437f-a04e-3164613fcb5a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.233367 Jul 20 22:46:47.547992 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 122/246] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:47 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:47.879192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0b177da8-db12-47b8-867b-3267d44b4035 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:47.879802 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0b177da8-db12-47b8-867b-3267d44b4035 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:47.887252 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0b177da8-db12-47b8-867b-3267d44b4035 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:47.887904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0b177da8-db12-47b8-867b-3267d44b4035 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:47.889519 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0b177da8-db12-47b8-867b-3267d44b4035 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:47.890091 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0b177da8-db12-47b8-867b-3267d44b4035 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:48.058002 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0b177da8-db12-47b8-867b-3267d44b4035 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:48.066143 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0b177da8-db12-47b8-867b-3267d44b4035 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.190858 Jul 20 22:46:48.066715 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 125/247] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:47 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:48.383461 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a238813f-936d-42c4-8439-0194f08dc88e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:48.384135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a238813f-936d-42c4-8439-0194f08dc88e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:48.391129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a238813f-936d-42c4-8439-0194f08dc88e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:48.391670 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a238813f-936d-42c4-8439-0194f08dc88e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:48.401054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a238813f-936d-42c4-8439-0194f08dc88e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:48.401054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a238813f-936d-42c4-8439-0194f08dc88e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:48.401054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:48.547357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-962c5558-9094-4375-9b35-0c346c29d959 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:48.548108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-962c5558-9094-4375-9b35-0c346c29d959 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:48.554931 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-962c5558-9094-4375-9b35-0c346c29d959 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:48.555605 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-962c5558-9094-4375-9b35-0c346c29d959 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:48.556491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-962c5558-9094-4375-9b35-0c346c29d959 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:48.557023 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-962c5558-9094-4375-9b35-0c346c29d959 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:48.568246 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a238813f-936d-42c4-8439-0194f08dc88e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:48.576915 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a238813f-936d-42c4-8439-0194f08dc88e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.197508 Jul 20 22:46:48.587498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 123/248] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:48 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:48.592796 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4f3f1b7f-b5c3-49be-94a8-f40cba4e64c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:48.593425 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4f3f1b7f-b5c3-49be-94a8-f40cba4e64c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:48.600022 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4f3f1b7f-b5c3-49be-94a8-f40cba4e64c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:48.600453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4f3f1b7f-b5c3-49be-94a8-f40cba4e64c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:48.601203 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4f3f1b7f-b5c3-49be-94a8-f40cba4e64c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:48.601621 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4f3f1b7f-b5c3-49be-94a8-f40cba4e64c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:48.728190 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-962c5558-9094-4375-9b35-0c346c29d959 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:48.738233 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-962c5558-9094-4375-9b35-0c346c29d959 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.195030 Jul 20 22:46:48.749360 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 126/249] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:48 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:48.808777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4f3f1b7f-b5c3-49be-94a8-f40cba4e64c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:48.809797 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4f3f1b7f-b5c3-49be-94a8-f40cba4e64c9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.221145 Jul 20 22:46:48.811050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 124/250] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:48 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:49.085426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-33b44d12-d673-4e13-991b-8e540930f448 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:49.086275 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-33b44d12-d673-4e13-991b-8e540930f448 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:49.094361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-33b44d12-d673-4e13-991b-8e540930f448 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:49.094801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-33b44d12-d673-4e13-991b-8e540930f448 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:49.095990 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-33b44d12-d673-4e13-991b-8e540930f448 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:49.100722 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-33b44d12-d673-4e13-991b-8e540930f448 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:49.237178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-33b44d12-d673-4e13-991b-8e540930f448 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:49.244785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-33b44d12-d673-4e13-991b-8e540930f448 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.164113 Jul 20 22:46:49.245347 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 127/251] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:49 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:49.594777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-453c0343-bf9e-4553-9047-58132d6d8639 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:49.595667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-453c0343-bf9e-4553-9047-58132d6d8639 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:49.602935 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-453c0343-bf9e-4553-9047-58132d6d8639 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:49.603542 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-453c0343-bf9e-4553-9047-58132d6d8639 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:49.604373 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-453c0343-bf9e-4553-9047-58132d6d8639 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:49.604909 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-453c0343-bf9e-4553-9047-58132d6d8639 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:49.755722 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-453c0343-bf9e-4553-9047-58132d6d8639 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:49.756141 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e83d5659-249f-4d67-ad4d-2d9f5e9b7d59 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:49.756895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e83d5659-249f-4d67-ad4d-2d9f5e9b7d59 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:49.764777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-453c0343-bf9e-4553-9047-58132d6d8639 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.174851 Jul 20 22:46:49.765581 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 125/252] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:49 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:49.774410 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e83d5659-249f-4d67-ad4d-2d9f5e9b7d59 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:49.774410 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e83d5659-249f-4d67-ad4d-2d9f5e9b7d59 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:49.774410 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e83d5659-249f-4d67-ad4d-2d9f5e9b7d59 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:49.774410 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e83d5659-249f-4d67-ad4d-2d9f5e9b7d59 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:49.829024 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fea32b52-4535-43ef-b9df-b082afe672c5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:49.829805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fea32b52-4535-43ef-b9df-b082afe672c5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:49.839916 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fea32b52-4535-43ef-b9df-b082afe672c5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:49.840509 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fea32b52-4535-43ef-b9df-b082afe672c5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:49.841989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fea32b52-4535-43ef-b9df-b082afe672c5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:49.842772 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fea32b52-4535-43ef-b9df-b082afe672c5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:49.922159 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e83d5659-249f-4d67-ad4d-2d9f5e9b7d59 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:49.931096 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e83d5659-249f-4d67-ad4d-2d9f5e9b7d59 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.178413 Jul 20 22:46:49.931335 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 128/253] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:49 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:49.992922 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fea32b52-4535-43ef-b9df-b082afe672c5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:50.000418 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fea32b52-4535-43ef-b9df-b082afe672c5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.177170 Jul 20 22:46:50.001000 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 126/254] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:49 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:50.261793 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5505755a-b56b-4699-8ad1-d0142bc71426 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:50.270044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5505755a-b56b-4699-8ad1-d0142bc71426 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:50.270044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5505755a-b56b-4699-8ad1-d0142bc71426 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:50.270044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5505755a-b56b-4699-8ad1-d0142bc71426 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:50.270525 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5505755a-b56b-4699-8ad1-d0142bc71426 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:50.270953 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5505755a-b56b-4699-8ad1-d0142bc71426 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:50.404966 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5505755a-b56b-4699-8ad1-d0142bc71426 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:50.412815 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5505755a-b56b-4699-8ad1-d0142bc71426 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.154766 Jul 20 22:46:50.413606 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 129/255] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:50 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:50.781848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-72d3bc46-7dfb-4a42-86d4-408c1eab20d0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:50.782701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-72d3bc46-7dfb-4a42-86d4-408c1eab20d0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:50.788798 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-72d3bc46-7dfb-4a42-86d4-408c1eab20d0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:50.789244 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-72d3bc46-7dfb-4a42-86d4-408c1eab20d0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:50.790001 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-72d3bc46-7dfb-4a42-86d4-408c1eab20d0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:50.790434 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-72d3bc46-7dfb-4a42-86d4-408c1eab20d0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:50.924294 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-72d3bc46-7dfb-4a42-86d4-408c1eab20d0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:50.931800 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-72d3bc46-7dfb-4a42-86d4-408c1eab20d0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.154304 Jul 20 22:46:50.932312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 127/256] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:50 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:50.947291 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fb2c6a55-d7ea-43ac-b16f-d03c11f9e179 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:50.947902 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fb2c6a55-d7ea-43ac-b16f-d03c11f9e179 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:50.954726 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a55-d7ea-43ac-b16f-d03c11f9e179 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:50.955216 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a55-d7ea-43ac-b16f-d03c11f9e179 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:50.960982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a55-d7ea-43ac-b16f-d03c11f9e179 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:50.960982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb2c6a55-d7ea-43ac-b16f-d03c11f9e179 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:51.017702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-77817fe2-e7a8-49a1-95ea-6760cdb10671 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:51.018154 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-77817fe2-e7a8-49a1-95ea-6760cdb10671 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:51.024534 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-77817fe2-e7a8-49a1-95ea-6760cdb10671 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:51.025017 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-77817fe2-e7a8-49a1-95ea-6760cdb10671 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:51.026500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-77817fe2-e7a8-49a1-95ea-6760cdb10671 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:51.027269 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-77817fe2-e7a8-49a1-95ea-6760cdb10671 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:51.098370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fb2c6a55-d7ea-43ac-b16f-d03c11f9e179 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:51.105766 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fb2c6a55-d7ea-43ac-b16f-d03c11f9e179 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.162137 Jul 20 22:46:51.106353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 130/257] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:50 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:51.164870 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-77817fe2-e7a8-49a1-95ea-6760cdb10671 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:51.172970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-77817fe2-e7a8-49a1-95ea-6760cdb10671 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.159732 Jul 20 22:46:51.173528 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 128/258] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:51 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:51.445480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-58a94857-ece7-4493-b04c-18ba4f848908 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:51.445480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-58a94857-ece7-4493-b04c-18ba4f848908 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:51.445480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:51.445480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-58a94857-ece7-4493-b04c-18ba4f848908 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:51.445480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-58a94857-ece7-4493-b04c-18ba4f848908 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:51.445895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-58a94857-ece7-4493-b04c-18ba4f848908 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:51.445895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-58a94857-ece7-4493-b04c-18ba4f848908 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:51.688401 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-58a94857-ece7-4493-b04c-18ba4f848908 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:51.703791 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-58a94857-ece7-4493-b04c-18ba4f848908 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.267369 Jul 20 22:46:51.703791 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 131/259] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:51 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:51.949109 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0b6364b8-eaeb-49d6-91e1-ccf22aa4025d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:51.949729 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0b6364b8-eaeb-49d6-91e1-ccf22aa4025d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:51.956777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0b6364b8-eaeb-49d6-91e1-ccf22aa4025d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:51.957217 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0b6364b8-eaeb-49d6-91e1-ccf22aa4025d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:51.957968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0b6364b8-eaeb-49d6-91e1-ccf22aa4025d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:51.958389 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0b6364b8-eaeb-49d6-91e1-ccf22aa4025d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:52.122213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-223aa385-6c67-4160-b3b6-98934f2287ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:52.122876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-223aa385-6c67-4160-b3b6-98934f2287ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:52.129151 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-223aa385-6c67-4160-b3b6-98934f2287ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:52.129591 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-223aa385-6c67-4160-b3b6-98934f2287ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:52.133441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-223aa385-6c67-4160-b3b6-98934f2287ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:52.133441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-223aa385-6c67-4160-b3b6-98934f2287ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:52.136922 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0b6364b8-eaeb-49d6-91e1-ccf22aa4025d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:52.145202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0b6364b8-eaeb-49d6-91e1-ccf22aa4025d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.200056 Jul 20 22:46:52.145928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 129/260] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:51 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:52.191372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-44cea3aa-87a6-49db-8fdc-ea627ec0fbd0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:52.191980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-44cea3aa-87a6-49db-8fdc-ea627ec0fbd0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:52.198283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-44cea3aa-87a6-49db-8fdc-ea627ec0fbd0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:52.198726 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-44cea3aa-87a6-49db-8fdc-ea627ec0fbd0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:52.199520 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-44cea3aa-87a6-49db-8fdc-ea627ec0fbd0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:52.199946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-44cea3aa-87a6-49db-8fdc-ea627ec0fbd0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:52.269688 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-223aa385-6c67-4160-b3b6-98934f2287ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:52.277358 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-223aa385-6c67-4160-b3b6-98934f2287ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.159182 Jul 20 22:46:52.278212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 132/261] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:52 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:52.398486 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-44cea3aa-87a6-49db-8fdc-ea627ec0fbd0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:52.409205 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-44cea3aa-87a6-49db-8fdc-ea627ec0fbd0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.223425 Jul 20 22:46:52.411072 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 130/262] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:52 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:52.717617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-785d83a5-8efc-4c0d-b6b6-d4a65d0ac06c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:52.718069 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-785d83a5-8efc-4c0d-b6b6-d4a65d0ac06c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:52.733786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-785d83a5-8efc-4c0d-b6b6-d4a65d0ac06c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:52.734496 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-785d83a5-8efc-4c0d-b6b6-d4a65d0ac06c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:52.735305 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-785d83a5-8efc-4c0d-b6b6-d4a65d0ac06c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:52.735885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-785d83a5-8efc-4c0d-b6b6-d4a65d0ac06c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:52.900991 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-785d83a5-8efc-4c0d-b6b6-d4a65d0ac06c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:52.908767 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-785d83a5-8efc-4c0d-b6b6-d4a65d0ac06c tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.195031 Jul 20 22:46:52.909371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 133/263] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:52 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:53.163506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c2941ccb-4488-41e3-9ac0-23e827c0d6d1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:53.164129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c2941ccb-4488-41e3-9ac0-23e827c0d6d1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:53.171586 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2941ccb-4488-41e3-9ac0-23e827c0d6d1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:53.172035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2941ccb-4488-41e3-9ac0-23e827c0d6d1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:53.172833 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2941ccb-4488-41e3-9ac0-23e827c0d6d1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:53.173320 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2941ccb-4488-41e3-9ac0-23e827c0d6d1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:53.296171 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ed60567a-6106-49dc-9c35-88f2622d2ccb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:53.296709 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ed60567a-6106-49dc-9c35-88f2622d2ccb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:53.306289 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c2941ccb-4488-41e3-9ac0-23e827c0d6d1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:53.308484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed60567a-6106-49dc-9c35-88f2622d2ccb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:53.308963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed60567a-6106-49dc-9c35-88f2622d2ccb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:53.309768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed60567a-6106-49dc-9c35-88f2622d2ccb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:53.310239 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed60567a-6106-49dc-9c35-88f2622d2ccb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:53.314138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c2941ccb-4488-41e3-9ac0-23e827c0d6d1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.154587 Jul 20 22:46:53.314926 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 131/264] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:53 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:53.427521 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-72dd39b3-de33-4300-bf17-282e9cf4f911 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:53.428172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-72dd39b3-de33-4300-bf17-282e9cf4f911 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:53.434084 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-72dd39b3-de33-4300-bf17-282e9cf4f911 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:53.434527 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-72dd39b3-de33-4300-bf17-282e9cf4f911 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:53.435310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-72dd39b3-de33-4300-bf17-282e9cf4f911 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:53.435742 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-72dd39b3-de33-4300-bf17-282e9cf4f911 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:53.446652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ed60567a-6106-49dc-9c35-88f2622d2ccb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:53.455473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ed60567a-6106-49dc-9c35-88f2622d2ccb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.163942 Jul 20 22:46:53.456134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 134/265] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:53 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:53.572566 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-72dd39b3-de33-4300-bf17-282e9cf4f911 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:53.583202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-72dd39b3-de33-4300-bf17-282e9cf4f911 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.159331 Jul 20 22:46:53.583909 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 132/266] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:53 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:53.925953 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e94b63a5-b837-47fd-b31b-5d11ea02e638 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:53.926553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e94b63a5-b837-47fd-b31b-5d11ea02e638 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:53.932661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e94b63a5-b837-47fd-b31b-5d11ea02e638 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:53.933101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e94b63a5-b837-47fd-b31b-5d11ea02e638 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:53.934480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e94b63a5-b837-47fd-b31b-5d11ea02e638 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:53.934480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e94b63a5-b837-47fd-b31b-5d11ea02e638 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:54.098648 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e94b63a5-b837-47fd-b31b-5d11ea02e638 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:54.106013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e94b63a5-b837-47fd-b31b-5d11ea02e638 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.183925 Jul 20 22:46:54.106619 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 135/267] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:53 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:54.330526 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-89eacfa6-d4e5-48b0-a98d-26c0ce26126b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:54.331242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-89eacfa6-d4e5-48b0-a98d-26c0ce26126b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:54.338658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-89eacfa6-d4e5-48b0-a98d-26c0ce26126b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:54.339220 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-89eacfa6-d4e5-48b0-a98d-26c0ce26126b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:54.340045 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-89eacfa6-d4e5-48b0-a98d-26c0ce26126b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:54.340556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-89eacfa6-d4e5-48b0-a98d-26c0ce26126b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:54.463544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-22de4905-5da0-418a-8104-ff64dbd84932 req-e7d6ab5c-67d7-4a40-ac52-3968b848e530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824101ca-4631-4acf-a133-48665389e37a", "name": "network-vif-plugged", "status": "completed", "tag": "690240d6-0f53-4a3c-839f-1fa4c80f81d8"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:54.476544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-22de4905-5da0-418a-8104-ff64dbd84932 req-e7d6ab5c-67d7-4a40-ac52-3968b848e530 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:54.477147 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-22de4905-5da0-418a-8104-ff64dbd84932 req-e7d6ab5c-67d7-4a40-ac52-3968b848e530 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:54.487672 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-89eacfa6-d4e5-48b0-a98d-26c0ce26126b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:54.490465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-22de4905-5da0-418a-8104-ff64dbd84932 req-e7d6ab5c-67d7-4a40-ac52-3968b848e530 service nova] Creating event network-vif-plugged:690240d6-0f53-4a3c-839f-1fa4c80f81d8 for instance 824101ca-4631-4acf-a133-48665389e37a on hv-cinder-79987 Jul 20 22:46:54.496017 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-22de4905-5da0-418a-8104-ff64dbd84932 req-e7d6ab5c-67d7-4a40-ac52-3968b848e530 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038267 Jul 20 22:46:54.496692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 136/268] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:46:54.499800 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-89eacfa6-d4e5-48b0-a98d-26c0ce26126b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.173060 Jul 20 22:46:54.500572 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 133/269] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:54 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:54.503376 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a8de8886-8a03-49a0-a4c7-8421f7fef30b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:54.504067 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a8de8886-8a03-49a0-a4c7-8421f7fef30b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:54.512443 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8de8886-8a03-49a0-a4c7-8421f7fef30b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:54.512916 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8de8886-8a03-49a0-a4c7-8421f7fef30b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:54.513750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8de8886-8a03-49a0-a4c7-8421f7fef30b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:54.514179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8de8886-8a03-49a0-a4c7-8421f7fef30b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:54.605292 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c51eb3dd-7dd8-4d97-83d6-ae071394a541 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:54.608608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c51eb3dd-7dd8-4d97-83d6-ae071394a541 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:54.623658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c51eb3dd-7dd8-4d97-83d6-ae071394a541 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:54.624107 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c51eb3dd-7dd8-4d97-83d6-ae071394a541 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:54.624877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c51eb3dd-7dd8-4d97-83d6-ae071394a541 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:54.625307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c51eb3dd-7dd8-4d97-83d6-ae071394a541 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:54.739383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a8de8886-8a03-49a0-a4c7-8421f7fef30b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:54.747298 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a8de8886-8a03-49a0-a4c7-8421f7fef30b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.248570 Jul 20 22:46:54.747876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 137/270] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:54 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:54.788619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c51eb3dd-7dd8-4d97-83d6-ae071394a541 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:54.801218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c51eb3dd-7dd8-4d97-83d6-ae071394a541 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.202528 Jul 20 22:46:54.801903 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 134/271] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:54 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:55.123150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a4e6927e-693a-43fb-95e8-c2597d058530 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:55.123774 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a4e6927e-693a-43fb-95e8-c2597d058530 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:55.142133 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a4e6927e-693a-43fb-95e8-c2597d058530 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:55.142584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a4e6927e-693a-43fb-95e8-c2597d058530 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:55.143395 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a4e6927e-693a-43fb-95e8-c2597d058530 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:55.143839 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a4e6927e-693a-43fb-95e8-c2597d058530 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:55.280260 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a4e6927e-693a-43fb-95e8-c2597d058530 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:55.381270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a4e6927e-693a-43fb-95e8-c2597d058530 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.261909 Jul 20 22:46:55.381993 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 138/272] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:55 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:55.517805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-91b27ec4-9bf8-4f75-8bbd-46fad81daf27 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:55.519339 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-91b27ec4-9bf8-4f75-8bbd-46fad81daf27 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:55.525755 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91b27ec4-9bf8-4f75-8bbd-46fad81daf27 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:55.526199 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91b27ec4-9bf8-4f75-8bbd-46fad81daf27 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:55.526961 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91b27ec4-9bf8-4f75-8bbd-46fad81daf27 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:55.527492 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91b27ec4-9bf8-4f75-8bbd-46fad81daf27 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:55.661226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-91b27ec4-9bf8-4f75-8bbd-46fad81daf27 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:55.668535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-91b27ec4-9bf8-4f75-8bbd-46fad81daf27 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.155300 Jul 20 22:46:55.669612 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 135/273] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:55 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:55.770515 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-194b0650-fe87-4cd6-9a2f-34253ae56cbb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:55.771341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-194b0650-fe87-4cd6-9a2f-34253ae56cbb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:55.780069 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-194b0650-fe87-4cd6-9a2f-34253ae56cbb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:55.780069 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-194b0650-fe87-4cd6-9a2f-34253ae56cbb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:55.780315 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-194b0650-fe87-4cd6-9a2f-34253ae56cbb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:55.780700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-194b0650-fe87-4cd6-9a2f-34253ae56cbb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:55.820156 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9d85cd43-0e8e-499d-a1f5-321fad703458 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:55.820963 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9d85cd43-0e8e-499d-a1f5-321fad703458 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:55.827986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9d85cd43-0e8e-499d-a1f5-321fad703458 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:55.828423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9d85cd43-0e8e-499d-a1f5-321fad703458 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:55.829213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9d85cd43-0e8e-499d-a1f5-321fad703458 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:55.829640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9d85cd43-0e8e-499d-a1f5-321fad703458 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:55.963771 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-194b0650-fe87-4cd6-9a2f-34253ae56cbb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:55.971734 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-194b0650-fe87-4cd6-9a2f-34253ae56cbb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.205433 Jul 20 22:46:55.972296 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 139/274] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:55 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:56.012803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9d85cd43-0e8e-499d-a1f5-321fad703458 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:56.020473 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9d85cd43-0e8e-499d-a1f5-321fad703458 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1362 microversion: 2.1 time: 0.206612 Jul 20 22:46:56.023355 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 136/275] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:55 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:56.399592 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ba2626ad-064b-4a0e-81ff-fb5537590783 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:56.400219 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ba2626ad-064b-4a0e-81ff-fb5537590783 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:56.406701 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba2626ad-064b-4a0e-81ff-fb5537590783 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:56.407446 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba2626ad-064b-4a0e-81ff-fb5537590783 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:56.408257 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba2626ad-064b-4a0e-81ff-fb5537590783 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:56.408693 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba2626ad-064b-4a0e-81ff-fb5537590783 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:56.589528 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ba2626ad-064b-4a0e-81ff-fb5537590783 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:56.597492 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ba2626ad-064b-4a0e-81ff-fb5537590783 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.202005 Jul 20 22:46:56.598063 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 140/276] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:56 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:56.685794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a3366e32-f8a3-47ba-9803-7601745714c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:56.686398 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a3366e32-f8a3-47ba-9803-7601745714c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:56.692633 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3366e32-f8a3-47ba-9803-7601745714c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:56.693081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3366e32-f8a3-47ba-9803-7601745714c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:56.693840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3366e32-f8a3-47ba-9803-7601745714c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:56.694273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3366e32-f8a3-47ba-9803-7601745714c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:56.869695 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a3366e32-f8a3-47ba-9803-7601745714c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:56.879362 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a3366e32-f8a3-47ba-9803-7601745714c5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.197320 Jul 20 22:46:56.879949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 137/277] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:56 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:57.007123 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8b473436-3200-447b-9307-c8b03b6e677c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:57.007730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8b473436-3200-447b-9307-c8b03b6e677c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:57.015641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8b473436-3200-447b-9307-c8b03b6e677c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.016216 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8b473436-3200-447b-9307-c8b03b6e677c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.016974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8b473436-3200-447b-9307-c8b03b6e677c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.017401 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8b473436-3200-447b-9307-c8b03b6e677c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.042715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d5e0edc3-7583-4b98-a3a4-eb56f48324f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:57.043589 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d5e0edc3-7583-4b98-a3a4-eb56f48324f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:57.053752 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5e0edc3-7583-4b98-a3a4-eb56f48324f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.054213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5e0edc3-7583-4b98-a3a4-eb56f48324f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.057854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5e0edc3-7583-4b98-a3a4-eb56f48324f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.058332 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5e0edc3-7583-4b98-a3a4-eb56f48324f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.240996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8b473436-3200-447b-9307-c8b03b6e677c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:57.254205 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8b473436-3200-447b-9307-c8b03b6e677c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.249651 Jul 20 22:46:57.255635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 141/278] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:57 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:57.301506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d5e0edc3-7583-4b98-a3a4-eb56f48324f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:57.312286 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d5e0edc3-7583-4b98-a3a4-eb56f48324f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1548 microversion: 2.1 time: 0.274853 Jul 20 22:46:57.313160 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 138/279] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:57 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1548 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:57.336203 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7687b4ab-6c92-4bc6-bd5a-e56525aec8cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:57.336828 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7687b4ab-6c92-4bc6-bd5a-e56525aec8cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:57.347940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7687b4ab-6c92-4bc6-bd5a-e56525aec8cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.352271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7687b4ab-6c92-4bc6-bd5a-e56525aec8cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.353114 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7687b4ab-6c92-4bc6-bd5a-e56525aec8cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.353656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7687b4ab-6c92-4bc6-bd5a-e56525aec8cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.384043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:57.489956 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7687b4ab-6c92-4bc6-bd5a-e56525aec8cf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158709 Jul 20 22:46:57.489956 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 142/280] 10.222.0.81 () {58 vars in 1274 bytes} [Wed Jul 20 22:46:57 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:46:57.616597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e2ce01d0-fb23-499b-be7d-9d7aeb463b0e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:57.617543 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e2ce01d0-fb23-499b-be7d-9d7aeb463b0e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:57.629341 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e2ce01d0-fb23-499b-be7d-9d7aeb463b0e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.631994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e2ce01d0-fb23-499b-be7d-9d7aeb463b0e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.632891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e2ce01d0-fb23-499b-be7d-9d7aeb463b0e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.633327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e2ce01d0-fb23-499b-be7d-9d7aeb463b0e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.907934 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-bbc2456c-6b0a-4c7b-9d8b-62db94cf9350 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:57.909078 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-bbc2456c-6b0a-4c7b-9d8b-62db94cf9350 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:57.922684 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bbc2456c-6b0a-4c7b-9d8b-62db94cf9350 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.923467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bbc2456c-6b0a-4c7b-9d8b-62db94cf9350 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.924952 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bbc2456c-6b0a-4c7b-9d8b-62db94cf9350 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:57.926025 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bbc2456c-6b0a-4c7b-9d8b-62db94cf9350 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:57.960672 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e2ce01d0-fb23-499b-be7d-9d7aeb463b0e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:57.966616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:46:57.968947 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e2ce01d0-fb23-499b-be7d-9d7aeb463b0e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.358110 Jul 20 22:46:57.978680 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 139/281] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:57 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:58.274786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0599ad22-b05d-4da9-83e9-d73ba47782b0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:58.275169 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0599ad22-b05d-4da9-83e9-d73ba47782b0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:58.283181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0599ad22-b05d-4da9-83e9-d73ba47782b0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:58.284156 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0599ad22-b05d-4da9-83e9-d73ba47782b0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:58.285260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0599ad22-b05d-4da9-83e9-d73ba47782b0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:58.285966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0599ad22-b05d-4da9-83e9-d73ba47782b0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:58.361591 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-bbc2456c-6b0a-4c7b-9d8b-62db94cf9350 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:58.370634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-bbc2456c-6b0a-4c7b-9d8b-62db94cf9350 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.477399 Jul 20 22:46:58.371278 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 143/282] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:57 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:58.705337 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0599ad22-b05d-4da9-83e9-d73ba47782b0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:58.713374 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0599ad22-b05d-4da9-83e9-d73ba47782b0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.444051 Jul 20 22:46:58.714033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 140/283] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:58 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:58.877802 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-597a5516-1c15-4fe5-a750-314742c94e69 req-7c25c5be-f55a-43a7-be81-d7b5f1883d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26d2070-596e-440d-8b3b-39be974f5bd3", "name": "network-vif-plugged", "status": "completed", "tag": "3ef07cb8-939b-46e3-b2ca-eedb58f07b4a"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:58.887550 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-597a5516-1c15-4fe5-a750-314742c94e69 req-7c25c5be-f55a-43a7-be81-d7b5f1883d2d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:58.888075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-597a5516-1c15-4fe5-a750-314742c94e69 req-7c25c5be-f55a-43a7-be81-d7b5f1883d2d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:58.900451 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-597a5516-1c15-4fe5-a750-314742c94e69 req-7c25c5be-f55a-43a7-be81-d7b5f1883d2d service nova] Creating event network-vif-plugged:3ef07cb8-939b-46e3-b2ca-eedb58f07b4a for instance b26d2070-596e-440d-8b3b-39be974f5bd3 on hv-cinder-79987 Jul 20 22:46:58.905958 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-597a5516-1c15-4fe5-a750-314742c94e69 req-7c25c5be-f55a-43a7-be81-d7b5f1883d2d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032426 Jul 20 22:46:58.906564 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 144/284] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:46:58.986444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f9d93fb7-6beb-44a3-a88e-d923f443f7ef tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:58.987401 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f9d93fb7-6beb-44a3-a88e-d923f443f7ef tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:58.993898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9d93fb7-6beb-44a3-a88e-d923f443f7ef tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:58.994418 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9d93fb7-6beb-44a3-a88e-d923f443f7ef tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:58.995443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9d93fb7-6beb-44a3-a88e-d923f443f7ef tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:58.996002 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9d93fb7-6beb-44a3-a88e-d923f443f7ef tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:59.324836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f9d93fb7-6beb-44a3-a88e-d923f443f7ef tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:59.332353 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f9d93fb7-6beb-44a3-a88e-d923f443f7ef tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.349962 Jul 20 22:46:59.342110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 141/285] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:58 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:46:59.390055 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b361196e-3712-4596-ac3d-74debd01aa9d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:59.390740 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b361196e-3712-4596-ac3d-74debd01aa9d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:59.396991 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b361196e-3712-4596-ac3d-74debd01aa9d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:59.397428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b361196e-3712-4596-ac3d-74debd01aa9d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:59.410779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b361196e-3712-4596-ac3d-74debd01aa9d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:59.410779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b361196e-3712-4596-ac3d-74debd01aa9d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:59.570638 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b361196e-3712-4596-ac3d-74debd01aa9d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:59.579342 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b361196e-3712-4596-ac3d-74debd01aa9d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.194351 Jul 20 22:46:59.587160 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 145/286] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:59 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:46:59.732862 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-95264016-9f78-44c8-a052-38f4439f2023 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:46:59.732862 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-95264016-9f78-44c8-a052-38f4439f2023 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:46:59.738626 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-95264016-9f78-44c8-a052-38f4439f2023 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:59.739190 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-95264016-9f78-44c8-a052-38f4439f2023 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:59.740061 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-95264016-9f78-44c8-a052-38f4439f2023 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:59.740596 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-95264016-9f78-44c8-a052-38f4439f2023 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:59.765374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-4e178fc8-f79e-4ad6-99b0-04869d0e18d1 req-8555e9a9-d17a-4899-a559-73ba34c11170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cce8a500-8166-4cb3-bc33-41c35ef48651", "tag": "10d19aff-cf1c-4e78-abf5-f4fd95873ab9"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:46:59.783470 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-4e178fc8-f79e-4ad6-99b0-04869d0e18d1 req-8555e9a9-d17a-4899-a559-73ba34c11170 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:46:59.791846 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-4e178fc8-f79e-4ad6-99b0-04869d0e18d1 req-8555e9a9-d17a-4899-a559-73ba34c11170 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:46:59.813713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-4e178fc8-f79e-4ad6-99b0-04869d0e18d1 req-8555e9a9-d17a-4899-a559-73ba34c11170 service nova] Creating event network-changed:10d19aff-cf1c-4e78-abf5-f4fd95873ab9 for instance cce8a500-8166-4cb3-bc33-41c35ef48651 on hv-cinder-79987 Jul 20 22:46:59.820998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-4e178fc8-f79e-4ad6-99b0-04869d0e18d1 req-8555e9a9-d17a-4899-a559-73ba34c11170 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064005 Jul 20 22:46:59.821753 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 146/287] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:46:59.947064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-95264016-9f78-44c8-a052-38f4439f2023 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:46:59.956113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-95264016-9f78-44c8-a052-38f4439f2023 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.229558 Jul 20 22:46:59.957152 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 142/288] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:46:59 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:47:00.350003 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-401b3ad0-204e-4c54-8cfe-f6a365f7ec12 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:00.350789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-401b3ad0-204e-4c54-8cfe-f6a365f7ec12 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:00.362918 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-401b3ad0-204e-4c54-8cfe-f6a365f7ec12 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:00.364212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-401b3ad0-204e-4c54-8cfe-f6a365f7ec12 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:00.367712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-401b3ad0-204e-4c54-8cfe-f6a365f7ec12 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:00.368560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-401b3ad0-204e-4c54-8cfe-f6a365f7ec12 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:00.549310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-401b3ad0-204e-4c54-8cfe-f6a365f7ec12 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:00.559392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-401b3ad0-204e-4c54-8cfe-f6a365f7ec12 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1315 microversion: 2.1 time: 0.213222 Jul 20 22:47:00.568916 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 147/289] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:00 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:00.597344 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1f9375e1-ee33-406e-9a8f-ba8240d69646 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:00.597975 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1f9375e1-ee33-406e-9a8f-ba8240d69646 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:00.604899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1f9375e1-ee33-406e-9a8f-ba8240d69646 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:00.605811 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1f9375e1-ee33-406e-9a8f-ba8240d69646 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:00.606424 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1f9375e1-ee33-406e-9a8f-ba8240d69646 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:00.607817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1f9375e1-ee33-406e-9a8f-ba8240d69646 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:00.784359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1f9375e1-ee33-406e-9a8f-ba8240d69646 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:00.793011 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1f9375e1-ee33-406e-9a8f-ba8240d69646 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.199301 Jul 20 22:47:00.793514 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 143/290] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:00 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:47:00.974349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c1fea362-5f34-4a31-af9d-cd25017bef16 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:00.974944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c1fea362-5f34-4a31-af9d-cd25017bef16 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:00.982602 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c1fea362-5f34-4a31-af9d-cd25017bef16 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:00.983282 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c1fea362-5f34-4a31-af9d-cd25017bef16 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:00.984708 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c1fea362-5f34-4a31-af9d-cd25017bef16 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:00.985393 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c1fea362-5f34-4a31-af9d-cd25017bef16 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:01.255712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c1fea362-5f34-4a31-af9d-cd25017bef16 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:01.266687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c1fea362-5f34-4a31-af9d-cd25017bef16 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.296357 Jul 20 22:47:01.267551 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 148/291] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:00 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:01.575790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3b3a8947-2bf6-448b-8b70-fc84d5dda029 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:01.576319 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3b3a8947-2bf6-448b-8b70-fc84d5dda029 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:01.582422 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b3a8947-2bf6-448b-8b70-fc84d5dda029 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:01.582866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b3a8947-2bf6-448b-8b70-fc84d5dda029 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:01.583956 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b3a8947-2bf6-448b-8b70-fc84d5dda029 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:01.584411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b3a8947-2bf6-448b-8b70-fc84d5dda029 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:01.718634 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3b3a8947-2bf6-448b-8b70-fc84d5dda029 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:01.726306 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3b3a8947-2bf6-448b-8b70-fc84d5dda029 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1503 microversion: 2.1 time: 0.154317 Jul 20 22:47:01.726911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 144/292] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:01 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:47:01.809988 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8887b767-8f33-4600-94f3-adfee53fdb78 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:01.810830 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8887b767-8f33-4600-94f3-adfee53fdb78 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:01.817642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8887b767-8f33-4600-94f3-adfee53fdb78 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:01.818088 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8887b767-8f33-4600-94f3-adfee53fdb78 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:01.819101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8887b767-8f33-4600-94f3-adfee53fdb78 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:01.819540 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8887b767-8f33-4600-94f3-adfee53fdb78 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:01.985986 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8887b767-8f33-4600-94f3-adfee53fdb78 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:01.993543 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8887b767-8f33-4600-94f3-adfee53fdb78 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.187711 Jul 20 22:47:01.994098 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 149/293] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:01 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:02.285376 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3f1156a7-bedb-4495-85f2-7819376d6724 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:02.286254 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3f1156a7-bedb-4495-85f2-7819376d6724 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:02.293512 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3f1156a7-bedb-4495-85f2-7819376d6724 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:02.294206 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3f1156a7-bedb-4495-85f2-7819376d6724 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:02.295064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3f1156a7-bedb-4495-85f2-7819376d6724 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:02.295699 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3f1156a7-bedb-4495-85f2-7819376d6724 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:02.432750 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3f1156a7-bedb-4495-85f2-7819376d6724 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:02.440950 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3f1156a7-bedb-4495-85f2-7819376d6724 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.159983 Jul 20 22:47:02.441519 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 145/294] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:02 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:03.010573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cab66dc6-3f7c-4a7a-a53c-6ae325405eef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:03.011268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cab66dc6-3f7c-4a7a-a53c-6ae325405eef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:03.017357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cab66dc6-3f7c-4a7a-a53c-6ae325405eef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:03.017807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cab66dc6-3f7c-4a7a-a53c-6ae325405eef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:03.018569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cab66dc6-3f7c-4a7a-a53c-6ae325405eef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:03.019000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cab66dc6-3f7c-4a7a-a53c-6ae325405eef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:03.152684 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cab66dc6-3f7c-4a7a-a53c-6ae325405eef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:03.161171 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cab66dc6-3f7c-4a7a-a53c-6ae325405eef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.154558 Jul 20 22:47:03.161854 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 150/295] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:03 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:03.463232 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-51ae3aa7-e217-487f-8152-478e3eb6f475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:03.463232 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-51ae3aa7-e217-487f-8152-478e3eb6f475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:03.463996 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:03.469936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-51ae3aa7-e217-487f-8152-478e3eb6f475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:03.470384 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-51ae3aa7-e217-487f-8152-478e3eb6f475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:03.471318 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-51ae3aa7-e217-487f-8152-478e3eb6f475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:03.471825 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-51ae3aa7-e217-487f-8152-478e3eb6f475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:03.602217 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-51ae3aa7-e217-487f-8152-478e3eb6f475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:03.610060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-51ae3aa7-e217-487f-8152-478e3eb6f475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.155828 Jul 20 22:47:03.610623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 146/296] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:03 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:04.177471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-54cc4a5c-e0ea-4bf8-b379-300f722f9a7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:04.178082 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-54cc4a5c-e0ea-4bf8-b379-300f722f9a7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:04.195420 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-54cc4a5c-e0ea-4bf8-b379-300f722f9a7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:04.195872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-54cc4a5c-e0ea-4bf8-b379-300f722f9a7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:04.196646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-54cc4a5c-e0ea-4bf8-b379-300f722f9a7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:04.197077 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-54cc4a5c-e0ea-4bf8-b379-300f722f9a7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:04.348046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-54cc4a5c-e0ea-4bf8-b379-300f722f9a7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:04.355415 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-54cc4a5c-e0ea-4bf8-b379-300f722f9a7d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.181689 Jul 20 22:47:04.356189 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 151/297] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:04 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:04.632233 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7c613184-d284-47d9-87a5-27175aadabc5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:04.633000 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7c613184-d284-47d9-87a5-27175aadabc5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:04.642327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7c613184-d284-47d9-87a5-27175aadabc5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:04.642774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7c613184-d284-47d9-87a5-27175aadabc5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:04.643579 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7c613184-d284-47d9-87a5-27175aadabc5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:04.644101 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7c613184-d284-47d9-87a5-27175aadabc5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:04.785781 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7c613184-d284-47d9-87a5-27175aadabc5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:04.794866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7c613184-d284-47d9-87a5-27175aadabc5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.170510 Jul 20 22:47:04.795913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 147/298] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:04 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:05.372615 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6152047b-da81-4353-a344-05fb18033cf0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:05.373226 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6152047b-da81-4353-a344-05fb18033cf0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:05.379334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6152047b-da81-4353-a344-05fb18033cf0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:05.379777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6152047b-da81-4353-a344-05fb18033cf0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:05.380530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6152047b-da81-4353-a344-05fb18033cf0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:05.380969 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6152047b-da81-4353-a344-05fb18033cf0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:05.507835 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6152047b-da81-4353-a344-05fb18033cf0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:05.515675 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6152047b-da81-4353-a344-05fb18033cf0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.146840 Jul 20 22:47:05.516235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 152/299] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:05 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:05.812939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ce7c61ef-ea88-41bc-9fb2-f0aff92abb97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:05.813540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ce7c61ef-ea88-41bc-9fb2-f0aff92abb97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:05.819753 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce7c61ef-ea88-41bc-9fb2-f0aff92abb97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:05.820187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce7c61ef-ea88-41bc-9fb2-f0aff92abb97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:05.820956 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce7c61ef-ea88-41bc-9fb2-f0aff92abb97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:05.821410 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce7c61ef-ea88-41bc-9fb2-f0aff92abb97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:05.946067 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ce7c61ef-ea88-41bc-9fb2-f0aff92abb97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:05.954164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ce7c61ef-ea88-41bc-9fb2-f0aff92abb97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.145641 Jul 20 22:47:05.954724 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 148/300] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:05 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:06.533258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3b19dda6-aaca-4bf6-9919-749f93717cec tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:06.533876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3b19dda6-aaca-4bf6-9919-749f93717cec tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:06.539874 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3b19dda6-aaca-4bf6-9919-749f93717cec tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:06.540320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3b19dda6-aaca-4bf6-9919-749f93717cec tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:06.541075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3b19dda6-aaca-4bf6-9919-749f93717cec tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:06.541510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3b19dda6-aaca-4bf6-9919-749f93717cec tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:06.671106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3b19dda6-aaca-4bf6-9919-749f93717cec tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:06.678458 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3b19dda6-aaca-4bf6-9919-749f93717cec tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.150203 Jul 20 22:47:06.679035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 153/301] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:06 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:06.971954 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a6c86d66-3f48-4b2d-8de8-b3547e681f31 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:06.972560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a6c86d66-3f48-4b2d-8de8-b3547e681f31 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:06.978805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6c86d66-3f48-4b2d-8de8-b3547e681f31 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:06.979285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6c86d66-3f48-4b2d-8de8-b3547e681f31 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:06.980074 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6c86d66-3f48-4b2d-8de8-b3547e681f31 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:06.980555 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6c86d66-3f48-4b2d-8de8-b3547e681f31 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:07.112165 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a6c86d66-3f48-4b2d-8de8-b3547e681f31 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:07.120076 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a6c86d66-3f48-4b2d-8de8-b3547e681f31 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.151957 Jul 20 22:47:07.120655 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 149/302] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:06 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:07.694921 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0e540d5c-7c40-4dc8-9340-5a1a76905261 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:07.695541 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0e540d5c-7c40-4dc8-9340-5a1a76905261 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:07.701509 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0e540d5c-7c40-4dc8-9340-5a1a76905261 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:07.701946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0e540d5c-7c40-4dc8-9340-5a1a76905261 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:07.702685 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0e540d5c-7c40-4dc8-9340-5a1a76905261 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:07.703139 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0e540d5c-7c40-4dc8-9340-5a1a76905261 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:07.832653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0e540d5c-7c40-4dc8-9340-5a1a76905261 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:07.840010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0e540d5c-7c40-4dc8-9340-5a1a76905261 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.148956 Jul 20 22:47:07.840565 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 154/303] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:07 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:08.136411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7e220274-d08d-4fcc-8249-56d2fe5f01e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:08.137019 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7e220274-d08d-4fcc-8249-56d2fe5f01e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:08.143197 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e220274-d08d-4fcc-8249-56d2fe5f01e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:08.143644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e220274-d08d-4fcc-8249-56d2fe5f01e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:08.144485 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e220274-d08d-4fcc-8249-56d2fe5f01e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:08.145008 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e220274-d08d-4fcc-8249-56d2fe5f01e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:08.276056 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7e220274-d08d-4fcc-8249-56d2fe5f01e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:08.290435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7e220274-d08d-4fcc-8249-56d2fe5f01e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.157540 Jul 20 22:47:08.291030 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 150/304] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:08 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:08.856848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6be4251b-796e-4e5a-a9e4-dff1d92b0a03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:08.857463 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6be4251b-796e-4e5a-a9e4-dff1d92b0a03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:08.863488 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6be4251b-796e-4e5a-a9e4-dff1d92b0a03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:08.864053 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6be4251b-796e-4e5a-a9e4-dff1d92b0a03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:08.864988 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6be4251b-796e-4e5a-a9e4-dff1d92b0a03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:08.865580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6be4251b-796e-4e5a-a9e4-dff1d92b0a03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:09.094306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6be4251b-796e-4e5a-a9e4-dff1d92b0a03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:09.101881 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6be4251b-796e-4e5a-a9e4-dff1d92b0a03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1367 microversion: 2.1 time: 0.248760 Jul 20 22:47:09.102537 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 155/305] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:08 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:09.307850 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f45e39df-e11d-4c8e-a4b6-8efbe4b7f102 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:09.308427 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f45e39df-e11d-4c8e-a4b6-8efbe4b7f102 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:09.315081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f45e39df-e11d-4c8e-a4b6-8efbe4b7f102 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:09.315524 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f45e39df-e11d-4c8e-a4b6-8efbe4b7f102 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:09.316264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f45e39df-e11d-4c8e-a4b6-8efbe4b7f102 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:09.316689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f45e39df-e11d-4c8e-a4b6-8efbe4b7f102 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:09.455383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f45e39df-e11d-4c8e-a4b6-8efbe4b7f102 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:09.463022 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f45e39df-e11d-4c8e-a4b6-8efbe4b7f102 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.158933 Jul 20 22:47:09.463866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 151/306] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:09 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:09.920840 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d0e7e65e-70e1-4ed8-952e-20cd911e0b9e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f035704-b846-4073-a6f1-9638ce3000d3"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:47:09.926242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d0e7e65e-70e1-4ed8-952e-20cd911e0b9e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:09.928012 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d0e7e65e-70e1-4ed8-952e-20cd911e0b9e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:09.928447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d0e7e65e-70e1-4ed8-952e-20cd911e0b9e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:09.929196 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d0e7e65e-70e1-4ed8-952e-20cd911e0b9e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:09.929673 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d0e7e65e-70e1-4ed8-952e-20cd911e0b9e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:10.118304 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1abdc4fb-416c-4ab2-9dd5-00e63e99bfa5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:10.118917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1abdc4fb-416c-4ab2-9dd5-00e63e99bfa5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:10.124923 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1abdc4fb-416c-4ab2-9dd5-00e63e99bfa5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:10.125369 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1abdc4fb-416c-4ab2-9dd5-00e63e99bfa5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:10.126125 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1abdc4fb-416c-4ab2-9dd5-00e63e99bfa5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:10.126554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1abdc4fb-416c-4ab2-9dd5-00e63e99bfa5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:10.259776 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1abdc4fb-416c-4ab2-9dd5-00e63e99bfa5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:10.267875 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1abdc4fb-416c-4ab2-9dd5-00e63e99bfa5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1556 microversion: 2.1 time: 0.153604 Jul 20 22:47:10.268430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 152/307] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:10 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:10.284516 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-811da64f-1f4c-4e08-9cf7-cd6b2a9f0f22 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:10.285005 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-811da64f-1f4c-4e08-9cf7-cd6b2a9f0f22 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:10.290862 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-811da64f-1f4c-4e08-9cf7-cd6b2a9f0f22 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:10.291341 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-811da64f-1f4c-4e08-9cf7-cd6b2a9f0f22 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:10.297156 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-811da64f-1f4c-4e08-9cf7-cd6b2a9f0f22 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:10.297156 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-811da64f-1f4c-4e08-9cf7-cd6b2a9f0f22 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:10.366877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-811da64f-1f4c-4e08-9cf7-cd6b2a9f0f22 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086193 Jul 20 22:47:10.367519 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 153/308] 10.222.0.81 () {58 vars in 1274 bytes} [Wed Jul 20 22:47:10 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:47:10.479716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-71057771-d2c1-462c-ac75-844d79e3df80 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:10.480439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-71057771-d2c1-462c-ac75-844d79e3df80 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:10.486694 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-71057771-d2c1-462c-ac75-844d79e3df80 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:10.487169 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-71057771-d2c1-462c-ac75-844d79e3df80 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:10.487929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-71057771-d2c1-462c-ac75-844d79e3df80 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:10.488361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-71057771-d2c1-462c-ac75-844d79e3df80 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:10.721561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-71057771-d2c1-462c-ac75-844d79e3df80 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:10.729144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-71057771-d2c1-462c-ac75-844d79e3df80 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.253292 Jul 20 22:47:10.729702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 154/309] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:10 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:47:11.704526 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-894c8a09-f4af-472d-8d69-7610bd9cf155 req-55c9a45b-c6ad-48a1-b51a-a4a247478c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b26d2070-596e-440d-8b3b-39be974f5bd3", "tag": "3ef07cb8-939b-46e3-b2ca-eedb58f07b4a"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:47:11.713081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-894c8a09-f4af-472d-8d69-7610bd9cf155 req-55c9a45b-c6ad-48a1-b51a-a4a247478c25 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:11.713583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-894c8a09-f4af-472d-8d69-7610bd9cf155 req-55c9a45b-c6ad-48a1-b51a-a4a247478c25 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:11.725807 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-894c8a09-f4af-472d-8d69-7610bd9cf155 req-55c9a45b-c6ad-48a1-b51a-a4a247478c25 service nova] Creating event network-changed:3ef07cb8-939b-46e3-b2ca-eedb58f07b4a for instance b26d2070-596e-440d-8b3b-39be974f5bd3 on hv-cinder-79987 Jul 20 22:47:11.731317 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-894c8a09-f4af-472d-8d69-7610bd9cf155 req-55c9a45b-c6ad-48a1-b51a-a4a247478c25 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031676 Jul 20 22:47:11.736634 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 155/310] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:47:11.745896 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9e713c42-7dd1-4740-8674-9308eef004d8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:11.746593 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9e713c42-7dd1-4740-8674-9308eef004d8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:11.754493 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e713c42-7dd1-4740-8674-9308eef004d8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:11.754938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e713c42-7dd1-4740-8674-9308eef004d8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:11.755727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e713c42-7dd1-4740-8674-9308eef004d8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:11.756167 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e713c42-7dd1-4740-8674-9308eef004d8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:11.895262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9e713c42-7dd1-4740-8674-9308eef004d8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:11.902964 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9e713c42-7dd1-4740-8674-9308eef004d8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.161125 Jul 20 22:47:11.903546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 156/311] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:11 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:47:12.920253 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8d21833c-9215-4b9c-a3d9-64720166666b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:12.920836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8d21833c-9215-4b9c-a3d9-64720166666b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:12.927140 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d21833c-9215-4b9c-a3d9-64720166666b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:12.927609 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d21833c-9215-4b9c-a3d9-64720166666b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:12.928348 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d21833c-9215-4b9c-a3d9-64720166666b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:12.928770 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d21833c-9215-4b9c-a3d9-64720166666b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:12.946297 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:13.054805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8d21833c-9215-4b9c-a3d9-64720166666b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:13.063300 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8d21833c-9215-4b9c-a3d9-64720166666b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.146871 Jul 20 22:47:13.063879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 157/312] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:12 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:47:14.079882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9661edf4-3e40-496c-9e83-81057968009c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:14.080490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9661edf4-3e40-496c-9e83-81057968009c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:14.086402 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9661edf4-3e40-496c-9e83-81057968009c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:14.086846 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9661edf4-3e40-496c-9e83-81057968009c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:14.087650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9661edf4-3e40-496c-9e83-81057968009c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:14.088089 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9661edf4-3e40-496c-9e83-81057968009c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:14.217504 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9661edf4-3e40-496c-9e83-81057968009c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:14.224915 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9661edf4-3e40-496c-9e83-81057968009c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.148910 Jul 20 22:47:14.225467 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 158/313] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:14 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:47:14.993521 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d0e7e65e-70e1-4ed8-952e-20cd911e0b9e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "POST /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.076401 Jul 20 22:47:14.994761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 156/314] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:47:09 2022] POST /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a/os-volume_attachments => generated 194 bytes in 5078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:15.242076 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d836f2c3-9a57-4cd5-bb8f-3aa271dc8d0c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:15.242696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d836f2c3-9a57-4cd5-bb8f-3aa271dc8d0c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:15.248718 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d836f2c3-9a57-4cd5-bb8f-3aa271dc8d0c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:15.250469 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d836f2c3-9a57-4cd5-bb8f-3aa271dc8d0c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:15.251328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d836f2c3-9a57-4cd5-bb8f-3aa271dc8d0c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:15.251775 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d836f2c3-9a57-4cd5-bb8f-3aa271dc8d0c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:15.382389 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d836f2c3-9a57-4cd5-bb8f-3aa271dc8d0c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:15.391138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d836f2c3-9a57-4cd5-bb8f-3aa271dc8d0c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.153259 Jul 20 22:47:15.391792 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 159/315] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:15 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:16.409603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-dfac0f1a-9b7b-4c1d-a936-1db42aedd91f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:16.410247 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-dfac0f1a-9b7b-4c1d-a936-1db42aedd91f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:16.416837 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dfac0f1a-9b7b-4c1d-a936-1db42aedd91f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:16.417285 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dfac0f1a-9b7b-4c1d-a936-1db42aedd91f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:16.418156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dfac0f1a-9b7b-4c1d-a936-1db42aedd91f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:16.419951 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dfac0f1a-9b7b-4c1d-a936-1db42aedd91f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:16.567946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-dfac0f1a-9b7b-4c1d-a936-1db42aedd91f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:16.578215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-dfac0f1a-9b7b-4c1d-a936-1db42aedd91f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.171972 Jul 20 22:47:16.578215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 157/316] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:16 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:17.593053 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e3a49acd-e83f-47cc-8183-c26e64f5eaaf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:17.593664 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e3a49acd-e83f-47cc-8183-c26e64f5eaaf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:17.599532 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3a49acd-e83f-47cc-8183-c26e64f5eaaf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:17.599969 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3a49acd-e83f-47cc-8183-c26e64f5eaaf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:17.600713 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3a49acd-e83f-47cc-8183-c26e64f5eaaf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:17.601138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3a49acd-e83f-47cc-8183-c26e64f5eaaf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:17.733152 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e3a49acd-e83f-47cc-8183-c26e64f5eaaf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:17.741103 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e3a49acd-e83f-47cc-8183-c26e64f5eaaf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.151971 Jul 20 22:47:17.741668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 160/317] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:17 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:18.759408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2ee1747a-fb30-441c-889d-c060db5516ab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:18.760722 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2ee1747a-fb30-441c-889d-c060db5516ab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:18.768408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2ee1747a-fb30-441c-889d-c060db5516ab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:18.769100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2ee1747a-fb30-441c-889d-c060db5516ab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:18.770202 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2ee1747a-fb30-441c-889d-c060db5516ab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:18.771461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2ee1747a-fb30-441c-889d-c060db5516ab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:18.901235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2ee1747a-fb30-441c-889d-c060db5516ab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:18.909584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2ee1747a-fb30-441c-889d-c060db5516ab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.154437 Jul 20 22:47:18.910138 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 158/318] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:18 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:19.925508 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-68a47544-bd07-42d1-b0d0-3a6efeac6e57 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:19.926146 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-68a47544-bd07-42d1-b0d0-3a6efeac6e57 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:19.932219 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-68a47544-bd07-42d1-b0d0-3a6efeac6e57 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:19.932655 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-68a47544-bd07-42d1-b0d0-3a6efeac6e57 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:19.933412 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-68a47544-bd07-42d1-b0d0-3a6efeac6e57 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:19.933881 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-68a47544-bd07-42d1-b0d0-3a6efeac6e57 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:20.067357 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-68a47544-bd07-42d1-b0d0-3a6efeac6e57 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:20.075420 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-68a47544-bd07-42d1-b0d0-3a6efeac6e57 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.153524 Jul 20 22:47:20.075956 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 161/319] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:19 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:21.093404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2544640b-c6e8-4449-afae-e4c3a83cee9b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:21.094092 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2544640b-c6e8-4449-afae-e4c3a83cee9b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:21.100962 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2544640b-c6e8-4449-afae-e4c3a83cee9b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:21.101413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2544640b-c6e8-4449-afae-e4c3a83cee9b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:21.102187 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2544640b-c6e8-4449-afae-e4c3a83cee9b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:21.102622 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2544640b-c6e8-4449-afae-e4c3a83cee9b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:21.106996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:21.253234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2544640b-c6e8-4449-afae-e4c3a83cee9b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:21.269367 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2544640b-c6e8-4449-afae-e4c3a83cee9b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.181214 Jul 20 22:47:21.270140 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 159/320] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:21 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:22.287806 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-90b23074-eacf-403e-90d3-2dbfd9e6c667 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:22.288361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-90b23074-eacf-403e-90d3-2dbfd9e6c667 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:22.295487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-90b23074-eacf-403e-90d3-2dbfd9e6c667 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:22.295854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-90b23074-eacf-403e-90d3-2dbfd9e6c667 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:22.296623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-90b23074-eacf-403e-90d3-2dbfd9e6c667 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:22.297097 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-90b23074-eacf-403e-90d3-2dbfd9e6c667 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:22.434224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-90b23074-eacf-403e-90d3-2dbfd9e6c667 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:22.441814 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-90b23074-eacf-403e-90d3-2dbfd9e6c667 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.158996 Jul 20 22:47:22.442377 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 162/321] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:22 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:23.459246 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-62edaf0b-d9f5-4535-9ca8-72ec3f9e0e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:23.459859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-62edaf0b-d9f5-4535-9ca8-72ec3f9e0e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:23.465579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=57 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:23.468427 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-62edaf0b-d9f5-4535-9ca8-72ec3f9e0e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:23.468878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-62edaf0b-d9f5-4535-9ca8-72ec3f9e0e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:23.469646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-62edaf0b-d9f5-4535-9ca8-72ec3f9e0e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:23.470081 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-62edaf0b-d9f5-4535-9ca8-72ec3f9e0e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:23.602225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-62edaf0b-d9f5-4535-9ca8-72ec3f9e0e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:23.610261 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-62edaf0b-d9f5-4535-9ca8-72ec3f9e0e17 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.154791 Jul 20 22:47:23.610990 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 160/322] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:23 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:24.627391 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d033f0b4-5a11-4e91-8e56-2292273028cf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:24.628025 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d033f0b4-5a11-4e91-8e56-2292273028cf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:24.634179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d033f0b4-5a11-4e91-8e56-2292273028cf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:24.634627 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d033f0b4-5a11-4e91-8e56-2292273028cf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:24.635416 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d033f0b4-5a11-4e91-8e56-2292273028cf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:24.635853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d033f0b4-5a11-4e91-8e56-2292273028cf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:24.781287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d033f0b4-5a11-4e91-8e56-2292273028cf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:24.788819 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d033f0b4-5a11-4e91-8e56-2292273028cf tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1520 microversion: 2.1 time: 0.165296 Jul 20 22:47:24.789319 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 163/323] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:24 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:25.814685 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5cb83e57-a286-41e4-bf94-013ceecfa277 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:25.814685 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5cb83e57-a286-41e4-bf94-013ceecfa277 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:25.814685 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5cb83e57-a286-41e4-bf94-013ceecfa277 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:25.814685 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5cb83e57-a286-41e4-bf94-013ceecfa277 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:25.815416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5cb83e57-a286-41e4-bf94-013ceecfa277 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:25.815416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5cb83e57-a286-41e4-bf94-013ceecfa277 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:25.988681 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5cb83e57-a286-41e4-bf94-013ceecfa277 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:25.998439 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5cb83e57-a286-41e4-bf94-013ceecfa277 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1500 microversion: 2.1 time: 0.196367 Jul 20 22:47:25.999418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 161/324] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:25 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1500 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:26.015952 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9b322ab4-d834-4ad3-a899-d6b92d0ec05f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:26.016556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9b322ab4-d834-4ad3-a899-d6b92d0ec05f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:26.022736 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b322ab4-d834-4ad3-a899-d6b92d0ec05f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:26.026608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b322ab4-d834-4ad3-a899-d6b92d0ec05f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:26.026608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b322ab4-d834-4ad3-a899-d6b92d0ec05f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:26.026608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b322ab4-d834-4ad3-a899-d6b92d0ec05f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:26.190250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9b322ab4-d834-4ad3-a899-d6b92d0ec05f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:26.199335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9b322ab4-d834-4ad3-a899-d6b92d0ec05f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1515 microversion: 2.1 time: 0.187355 Jul 20 22:47:26.210573 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 164/325] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:26 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:27.270350 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b4f6b125-a524-4b59-8537-aaa03b21bc08 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:27.270824 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b4f6b125-a524-4b59-8537-aaa03b21bc08 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:27.277450 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b4f6b125-a524-4b59-8537-aaa03b21bc08 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:27.277891 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b4f6b125-a524-4b59-8537-aaa03b21bc08 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:27.278651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b4f6b125-a524-4b59-8537-aaa03b21bc08 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:27.279101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b4f6b125-a524-4b59-8537-aaa03b21bc08 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:27.305916 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b4f6b125-a524-4b59-8537-aaa03b21bc08 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:47:27.622504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b4f6b125-a524-4b59-8537-aaa03b21bc08 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "DELETE /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 204 len: 0 microversion: 2.1 time: 0.355637 Jul 20 22:47:27.623105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 162/326] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:47:27 2022] DELETE /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:47:27.630998 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b043c818-b48d-4d3b-aa32-52a78f581b5e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:27.631629 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b043c818-b48d-4d3b-aa32-52a78f581b5e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:27.637616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b043c818-b48d-4d3b-aa32-52a78f581b5e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:27.638050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b043c818-b48d-4d3b-aa32-52a78f581b5e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:27.638831 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b043c818-b48d-4d3b-aa32-52a78f581b5e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:27.639285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b043c818-b48d-4d3b-aa32-52a78f581b5e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:27.784129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b043c818-b48d-4d3b-aa32-52a78f581b5e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:27.792604 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b043c818-b48d-4d3b-aa32-52a78f581b5e tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1555 microversion: 2.1 time: 0.165338 Jul 20 22:47:27.793829 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 165/327] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:27 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:28.815884 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-791cdce3-1a01-4151-bde9-71908973569d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:28.816761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-791cdce3-1a01-4151-bde9-71908973569d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:28.825377 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-791cdce3-1a01-4151-bde9-71908973569d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:28.825859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-791cdce3-1a01-4151-bde9-71908973569d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:28.826643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-791cdce3-1a01-4151-bde9-71908973569d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:28.827101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-791cdce3-1a01-4151-bde9-71908973569d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:28.958998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-791cdce3-1a01-4151-bde9-71908973569d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:28.967617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-791cdce3-1a01-4151-bde9-71908973569d tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1555 microversion: 2.1 time: 0.157646 Jul 20 22:47:28.968176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 163/328] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:28 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:29.206457 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-20e03854-d4eb-4115-a692-daac9253d394 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:47:29.207472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-20e03854-d4eb-4115-a692-daac9253d394 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:29.213894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-20e03854-d4eb-4115-a692-daac9253d394 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:29.213894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-20e03854-d4eb-4115-a692-daac9253d394 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:29.214709 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-20e03854-d4eb-4115-a692-daac9253d394 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:29.215192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-20e03854-d4eb-4115-a692-daac9253d394 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:29.256458 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-20e03854-d4eb-4115-a692-daac9253d394 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lazy-loading 'flavor' on Instance uuid ed11a51a-3574-43eb-a485-e6df2ded9fee {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:47:29.661704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-20e03854-d4eb-4115-a692-daac9253d394 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee/action" status: 200 len: 32 microversion: 2.1 time: 0.459084 Jul 20 22:47:29.662613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 166/329] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:47:29 2022] POST /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:47:29.672519 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1101370a-438a-445b-af75-95411e6035cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:29.673204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1101370a-438a-445b-af75-95411e6035cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:29.679385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1101370a-438a-445b-af75-95411e6035cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:29.679908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1101370a-438a-445b-af75-95411e6035cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:29.680740 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1101370a-438a-445b-af75-95411e6035cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:29.681239 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1101370a-438a-445b-af75-95411e6035cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:29.814129 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1101370a-438a-445b-af75-95411e6035cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:29.822211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1101370a-438a-445b-af75-95411e6035cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.153976 Jul 20 22:47:29.823172 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 164/330] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:29 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:29.986224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-208d31f0-8f65-4095-bfaf-cc3d69b0e4c3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:29.986939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-208d31f0-8f65-4095-bfaf-cc3d69b0e4c3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:29.993400 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-208d31f0-8f65-4095-bfaf-cc3d69b0e4c3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:29.993872 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-208d31f0-8f65-4095-bfaf-cc3d69b0e4c3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:29.994646 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-208d31f0-8f65-4095-bfaf-cc3d69b0e4c3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:29.995125 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-208d31f0-8f65-4095-bfaf-cc3d69b0e4c3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:30.130920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-208d31f0-8f65-4095-bfaf-cc3d69b0e4c3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:30.139310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-208d31f0-8f65-4095-bfaf-cc3d69b0e4c3 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1555 microversion: 2.1 time: 0.157534 Jul 20 22:47:30.147510 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 167/331] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:29 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:30.844232 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-577340fe-a46a-43e1-8103-fb43aa899c6a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:30.845516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-577340fe-a46a-43e1-8103-fb43aa899c6a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:30.853008 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-577340fe-a46a-43e1-8103-fb43aa899c6a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:30.853659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-577340fe-a46a-43e1-8103-fb43aa899c6a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:30.856168 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-577340fe-a46a-43e1-8103-fb43aa899c6a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:30.856168 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-577340fe-a46a-43e1-8103-fb43aa899c6a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:30.997299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-577340fe-a46a-43e1-8103-fb43aa899c6a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:31.004920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-577340fe-a46a-43e1-8103-fb43aa899c6a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.165070 Jul 20 22:47:31.005479 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 165/332] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:30 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:31.162521 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f9eb419a-850c-4654-876a-d0c44b7a205a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:31.163234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f9eb419a-850c-4654-876a-d0c44b7a205a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:31.170012 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9eb419a-850c-4654-876a-d0c44b7a205a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:31.170545 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9eb419a-850c-4654-876a-d0c44b7a205a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:31.171427 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9eb419a-850c-4654-876a-d0c44b7a205a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:31.171973 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9eb419a-850c-4654-876a-d0c44b7a205a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:31.433911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f9eb419a-850c-4654-876a-d0c44b7a205a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:31.444390 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f9eb419a-850c-4654-876a-d0c44b7a205a tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1555 microversion: 2.1 time: 0.283544 Jul 20 22:47:31.455913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 168/333] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:31 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1555 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:32.022103 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9bb091d5-4181-41b3-a6ac-d7b15b3690cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:32.022738 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9bb091d5-4181-41b3-a6ac-d7b15b3690cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:32.037379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-c022bae7-b57f-48dc-aa5b-a35ba72a47cf req-cc526601-fe13-4148-a3eb-9cd6045dfb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824101ca-4631-4acf-a133-48665389e37a", "name": "network-vif-deleted", "tag": "690240d6-0f53-4a3c-839f-1fa4c80f81d8"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:47:32.040705 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9bb091d5-4181-41b3-a6ac-d7b15b3690cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:32.041184 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9bb091d5-4181-41b3-a6ac-d7b15b3690cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:32.041986 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9bb091d5-4181-41b3-a6ac-d7b15b3690cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:32.042417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9bb091d5-4181-41b3-a6ac-d7b15b3690cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:32.046953 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c022bae7-b57f-48dc-aa5b-a35ba72a47cf req-cc526601-fe13-4148-a3eb-9cd6045dfb24 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:32.047832 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c022bae7-b57f-48dc-aa5b-a35ba72a47cf req-cc526601-fe13-4148-a3eb-9cd6045dfb24 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:32.069638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-c022bae7-b57f-48dc-aa5b-a35ba72a47cf req-cc526601-fe13-4148-a3eb-9cd6045dfb24 service nova] Creating event network-vif-deleted:690240d6-0f53-4a3c-839f-1fa4c80f81d8 for instance 824101ca-4631-4acf-a133-48665389e37a on hv-cinder-79987 Jul 20 22:47:32.078912 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-c022bae7-b57f-48dc-aa5b-a35ba72a47cf req-cc526601-fe13-4148-a3eb-9cd6045dfb24 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044667 Jul 20 22:47:32.083260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 169/334] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:32.204643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9bb091d5-4181-41b3-a6ac-d7b15b3690cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:32.212401 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9bb091d5-4181-41b3-a6ac-d7b15b3690cd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.194535 Jul 20 22:47:32.212968 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 166/335] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:32 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:32.462348 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9b2a09a6-a6e4-4bc9-84c3-bbd356f08ba6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:32.463207 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9b2a09a6-a6e4-4bc9-84c3-bbd356f08ba6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:32.479250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b2a09a6-a6e4-4bc9-84c3-bbd356f08ba6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:32.479250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b2a09a6-a6e4-4bc9-84c3-bbd356f08ba6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:32.479250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b2a09a6-a6e4-4bc9-84c3-bbd356f08ba6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:32.479250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b2a09a6-a6e4-4bc9-84c3-bbd356f08ba6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:32.537137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9b2a09a6-a6e4-4bc9-84c3-bbd356f08ba6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:32.545945 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9b2a09a6-a6e4-4bc9-84c3-bbd356f08ba6 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1346 microversion: 2.1 time: 0.087717 Jul 20 22:47:32.546511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 170/336] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:32 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:33.229664 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-45c196e4-cff4-49ed-933c-d7bcf2250fba tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:33.230274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-45c196e4-cff4-49ed-933c-d7bcf2250fba tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:33.236675 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-45c196e4-cff4-49ed-933c-d7bcf2250fba tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:33.237125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-45c196e4-cff4-49ed-933c-d7bcf2250fba tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:33.237882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-45c196e4-cff4-49ed-933c-d7bcf2250fba tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:33.238317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-45c196e4-cff4-49ed-933c-d7bcf2250fba tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:33.541696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-45c196e4-cff4-49ed-933c-d7bcf2250fba tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:33.549179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-45c196e4-cff4-49ed-933c-d7bcf2250fba tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.323426 Jul 20 22:47:33.549761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 167/337] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:33 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:33.563410 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:33.564103 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:33.570118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:33.570559 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:33.571342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:33.571770 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:33.739402 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:33.739851 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:33.740297 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lazy-loading 'fault' on Instance uuid 824101ca-4631-4acf-a133-48665389e37a {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:47:33.800981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:33.809768 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0e61777b-7fcf-463f-9fed-937696a942d9 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1351 microversion: 2.1 time: 0.250303 Jul 20 22:47:33.810335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 171/338] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:33 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1351 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:34.574013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fa416d1a-341a-4744-83c8-a3de82c98983 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:34.574013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fa416d1a-341a-4744-83c8-a3de82c98983 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:34.574013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fa416d1a-341a-4744-83c8-a3de82c98983 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:34.575312 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fa416d1a-341a-4744-83c8-a3de82c98983 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:34.575312 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fa416d1a-341a-4744-83c8-a3de82c98983 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:34.575634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fa416d1a-341a-4744-83c8-a3de82c98983 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:34.740772 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fa416d1a-341a-4744-83c8-a3de82c98983 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:34.756627 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fa416d1a-341a-4744-83c8-a3de82c98983 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.193469 Jul 20 22:47:34.761919 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 168/339] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:34 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:34.827403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:34.827939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:34.829946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=54 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:34.834610 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:34.835076 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:34.835870 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:34.836300 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:34.855354 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:34.868879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:34.869342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:34.869821 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lazy-loading 'fault' on Instance uuid 824101ca-4631-4acf-a133-48665389e37a {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:47:34.930840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b458e3837be425bba1f880895918287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '788c1d44ad5d442e8ec58f1d76ae649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:34.938170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ffe41a1b-07c8-4408-b67d-0c7f16184089 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 200 len: 1305 microversion: 2.1 time: 0.115203 Jul 20 22:47:34.938746 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 172/340] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:34 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:35.773707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-be63c351-6609-457a-a60b-85e2005ed5ff tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:35.774654 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-be63c351-6609-457a-a60b-85e2005ed5ff tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:35.781831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be63c351-6609-457a-a60b-85e2005ed5ff tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:35.782285 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be63c351-6609-457a-a60b-85e2005ed5ff tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:35.783051 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be63c351-6609-457a-a60b-85e2005ed5ff tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:35.783556 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be63c351-6609-457a-a60b-85e2005ed5ff tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:35.961162 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:35.962650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:35.971182 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:35.976988 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:35.976988 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:35.976988 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:35.987655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-be63c351-6609-457a-a60b-85e2005ed5ff tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:35.993819 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] HTTP exception thrown: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:35.996110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-be63c351-6609-457a-a60b-85e2005ed5ff tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.226227 Jul 20 22:47:36.003063 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 169/341] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:35 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Request method failure captured: Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a HTTP/1.1 Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWUWe3tz-79Hsdce4MLDhHzW1uX_lNJkwbTU9iG8KpuPpCMMutipRFRp1_WAkbUXbW9YwmjF1_ZJ9S6O7a2X2O5YniTNQElEfaubwg_ytZloPMRpRtpLWXg-eWUTzGUXDds1Aqw1VVJ_eCbnhM0NpEFgcoGfEp6C_UmsB74qc7QbA0 Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 788c1d44ad5d442e8ec58f1d76ae649b Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:47:36.003239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_788c1d44ad5d442e8ec58f1d76ae649b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 788c1d44ad5d442e8ec58f1d76ae649b Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-DeleteServersTestJSON-1931010822-project Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 1b458e3837be425bba1f880895918287 Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-DeleteServersTestJSON-1931010822-project Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.004740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '824101ca-4631-4acf-a133-48665389e37a'} Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:47:36.005606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.007060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.008285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Returning 404 to user: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:47:36.008285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-228a3e7e-7780-44a1-98ef-629a5f83dbb7 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 404 len: 111 microversion: 2.1 time: 0.042939 Jul 20 22:47:36.008285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 173/342] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:35 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:47:36.119061 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:36.120063 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:36.126199 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:36.126579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:36.127389 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:36.127820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:36.147093 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] HTTP exception thrown: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Request method failure captured: Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a/os-volume_attachments HTTP/1.1 Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUWe3tz-79Hsdce4MLDhHzW1uX_lNJkwbTU9iG8KpuPpCMMutipRFRp1_WAkbUXbW9YwmjF1_ZJ9S6O7a2X2O5YniTNQElEfaubwg_ytZloPMRpRtpLWXg-eWUTzGUXDds1Aqw1VVJ_eCbnhM0NpEFgcoGfEp6C_UmsB74qc7QbA0 Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 788c1d44ad5d442e8ec58f1d76ae649b Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:47:36.151524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_788c1d44ad5d442e8ec58f1d76ae649b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 788c1d44ad5d442e8ec58f1d76ae649b Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-DeleteServersTestJSON-1931010822-project Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 1b458e3837be425bba1f880895918287 Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-DeleteServersTestJSON-1931010822-project Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.153665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'server_id': '824101ca-4631-4acf-a133-48665389e37a'} Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:47:36.154511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:36.156162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:36.157664 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Returning 404 to user: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:47:36.158385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0aefbad1-c515-4bdb-8dbb-f949b8a7ef72 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043476 Jul 20 22:47:36.159279 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 170/343] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:47:36 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:47:37.014614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-366c7ece-656e-4254-bbda-d0239c68d0ea tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:37.015258 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-366c7ece-656e-4254-bbda-d0239c68d0ea tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:37.023932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-366c7ece-656e-4254-bbda-d0239c68d0ea tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:37.024831 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-366c7ece-656e-4254-bbda-d0239c68d0ea tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:37.032379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-366c7ece-656e-4254-bbda-d0239c68d0ea tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:37.032379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-366c7ece-656e-4254-bbda-d0239c68d0ea tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:37.171578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-366c7ece-656e-4254-bbda-d0239c68d0ea tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:37.180094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-366c7ece-656e-4254-bbda-d0239c68d0ea tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.170392 Jul 20 22:47:37.180855 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 174/344] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:37 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:37.519485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:37.519989 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:37.526838 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:37.527301 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:37.528093 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:37.528526 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:37.543094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] HTTP exception thrown: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Request method failure captured: Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a HTTP/1.1 Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUWe3tz-79Hsdce4MLDhHzW1uX_lNJkwbTU9iG8KpuPpCMMutipRFRp1_WAkbUXbW9YwmjF1_ZJ9S6O7a2X2O5YniTNQElEfaubwg_ytZloPMRpRtpLWXg-eWUTzGUXDds1Aqw1VVJ_eCbnhM0NpEFgcoGfEp6C_UmsB74qc7QbA0 Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 788c1d44ad5d442e8ec58f1d76ae649b Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:47:37.545307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_788c1d44ad5d442e8ec58f1d76ae649b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 788c1d44ad5d442e8ec58f1d76ae649b Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-DeleteServersTestJSON-1931010822-project Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 1b458e3837be425bba1f880895918287 Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-DeleteServersTestJSON-1931010822-project Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.546643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '824101ca-4631-4acf-a133-48665389e37a'} Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:47:37.547511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.548893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.550165 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Returning 404 to user: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:47:37.550165 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-da27c67a-fe1d-4db4-bf47-07b85e4eb5bb tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "DELETE /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 404 len: 111 microversion: 2.1 time: 0.031652 Jul 20 22:47:37.555221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:37.555826 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] [instance: 824101ca-4631-4acf-a133-48665389e37a] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:37.561147 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 171/345] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:47:37 2022] DELETE /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:47:37.562725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:37.563213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:37.563979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:37.564410 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:37.578744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] HTTP exception thrown: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Request method failure captured: Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a HTTP/1.1 Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWUWe3tz-79Hsdce4MLDhHzW1uX_lNJkwbTU9iG8KpuPpCMMutipRFRp1_WAkbUXbW9YwmjF1_ZJ9S6O7a2X2O5YniTNQElEfaubwg_ytZloPMRpRtpLWXg-eWUTzGUXDds1Aqw1VVJ_eCbnhM0NpEFgcoGfEp6C_UmsB74qc7QbA0 Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 788c1d44ad5d442e8ec58f1d76ae649b Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:47:37.580430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_788c1d44ad5d442e8ec58f1d76ae649b", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/788c1d44ad5d442e8ec58f1d76ae649b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 788c1d44ad5d442e8ec58f1d76ae649b Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931010822 Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-DeleteServersTestJSON-1931010822-project Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 1b458e3837be425bba1f880895918287 Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-DeleteServersTestJSON-1931010822-project Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.581761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '824101ca-4631-4acf-a133-48665389e37a'} Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:47:37.582499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. Jul 20 22:47:37.583715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:47:37.585221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] Returning 404 to user: Instance 824101ca-4631-4acf-a133-48665389e37a could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:47:37.585221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-897c9e99-d27c-4f56-bddf-5230c54967f4 tempest-DeleteServersTestJSON-1931010822 tempest-DeleteServersTestJSON-1931010822-project] 10.222.0.81 "GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a" status: 404 len: 111 microversion: 2.1 time: 0.030644 Jul 20 22:47:37.585221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 175/346] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:37 2022] GET /compute/v2.1/servers/824101ca-4631-4acf-a133-48665389e37a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:47:38.197416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7e6bb6fe-ed4a-43b9-b613-3221f661a568 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:38.198400 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7e6bb6fe-ed4a-43b9-b613-3221f661a568 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:38.206382 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7e6bb6fe-ed4a-43b9-b613-3221f661a568 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:38.207141 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7e6bb6fe-ed4a-43b9-b613-3221f661a568 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:38.208573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7e6bb6fe-ed4a-43b9-b613-3221f661a568 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:38.209169 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7e6bb6fe-ed4a-43b9-b613-3221f661a568 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:38.447665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7e6bb6fe-ed4a-43b9-b613-3221f661a568 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:38.455650 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7e6bb6fe-ed4a-43b9-b613-3221f661a568 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.262300 Jul 20 22:47:38.456309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 172/347] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:38 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:39.473934 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b5d0dd6b-b9da-4db0-a78a-24ba6823665f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:39.474656 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b5d0dd6b-b9da-4db0-a78a-24ba6823665f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:39.481957 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5d0dd6b-b9da-4db0-a78a-24ba6823665f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:39.482680 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5d0dd6b-b9da-4db0-a78a-24ba6823665f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:39.483698 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5d0dd6b-b9da-4db0-a78a-24ba6823665f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:39.484400 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5d0dd6b-b9da-4db0-a78a-24ba6823665f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:39.663579 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b5d0dd6b-b9da-4db0-a78a-24ba6823665f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:39.677051 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b5d0dd6b-b9da-4db0-a78a-24ba6823665f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.206981 Jul 20 22:47:39.677963 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 176/348] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:39 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:47:40.703287 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-748127ed-ddfb-49e4-a094-9914e47d1be0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:40.703287 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-748127ed-ddfb-49e4-a094-9914e47d1be0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:40.707433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-748127ed-ddfb-49e4-a094-9914e47d1be0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:40.711623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-748127ed-ddfb-49e4-a094-9914e47d1be0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:40.711623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-748127ed-ddfb-49e4-a094-9914e47d1be0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:40.711623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-748127ed-ddfb-49e4-a094-9914e47d1be0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:41.188213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-748127ed-ddfb-49e4-a094-9914e47d1be0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:41.200207 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-748127ed-ddfb-49e4-a094-9914e47d1be0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.505525 Jul 20 22:47:41.200822 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 173/349] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:40 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:42.217847 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-07e763f9-e2d5-4ae8-a5c8-7db7a42aae05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:42.218487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-07e763f9-e2d5-4ae8-a5c8-7db7a42aae05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:42.224928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-07e763f9-e2d5-4ae8-a5c8-7db7a42aae05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:42.225371 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-07e763f9-e2d5-4ae8-a5c8-7db7a42aae05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:42.226200 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-07e763f9-e2d5-4ae8-a5c8-7db7a42aae05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:42.226630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-07e763f9-e2d5-4ae8-a5c8-7db7a42aae05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:42.404425 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-07e763f9-e2d5-4ae8-a5c8-7db7a42aae05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:42.412298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-07e763f9-e2d5-4ae8-a5c8-7db7a42aae05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.198878 Jul 20 22:47:42.413109 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 177/350] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:42 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:43.435768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-20cd541c-26b9-4d40-9959-2aad3d735df9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:43.438064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-20cd541c-26b9-4d40-9959-2aad3d735df9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:43.446993 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-20cd541c-26b9-4d40-9959-2aad3d735df9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:43.447831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-20cd541c-26b9-4d40-9959-2aad3d735df9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:43.450682 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-20cd541c-26b9-4d40-9959-2aad3d735df9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:43.451433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-20cd541c-26b9-4d40-9959-2aad3d735df9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:43.594293 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-20cd541c-26b9-4d40-9959-2aad3d735df9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:43.608048 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-20cd541c-26b9-4d40-9959-2aad3d735df9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.181799 Jul 20 22:47:43.608823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 174/351] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:43 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:44.625854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a3d1bdf3-e2c7-4bf5-8631-5adce4801ad0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:44.626454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a3d1bdf3-e2c7-4bf5-8631-5adce4801ad0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:44.632545 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3d1bdf3-e2c7-4bf5-8631-5adce4801ad0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:44.632987 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3d1bdf3-e2c7-4bf5-8631-5adce4801ad0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:44.637615 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3d1bdf3-e2c7-4bf5-8631-5adce4801ad0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:44.637615 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3d1bdf3-e2c7-4bf5-8631-5adce4801ad0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:44.766850 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a3d1bdf3-e2c7-4bf5-8631-5adce4801ad0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:44.774453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a3d1bdf3-e2c7-4bf5-8631-5adce4801ad0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.152513 Jul 20 22:47:44.775004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 178/352] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:44 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:45.793077 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-90358d2a-6c16-4f2e-a467-1581f0cf0e7e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:45.793694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-90358d2a-6c16-4f2e-a467-1581f0cf0e7e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:45.803058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-90358d2a-6c16-4f2e-a467-1581f0cf0e7e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:45.803512 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-90358d2a-6c16-4f2e-a467-1581f0cf0e7e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:45.804282 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-90358d2a-6c16-4f2e-a467-1581f0cf0e7e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:45.804713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-90358d2a-6c16-4f2e-a467-1581f0cf0e7e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:45.825704 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:45.944332 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-90358d2a-6c16-4f2e-a467-1581f0cf0e7e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:45.951735 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-90358d2a-6c16-4f2e-a467-1581f0cf0e7e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.162986 Jul 20 22:47:45.952295 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 175/353] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:45 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:46.968248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9c94cf87-0c66-49cc-aef9-b4f15a36935a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:46.968853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9c94cf87-0c66-49cc-aef9-b4f15a36935a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:46.975322 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c94cf87-0c66-49cc-aef9-b4f15a36935a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:46.975769 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c94cf87-0c66-49cc-aef9-b4f15a36935a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:46.976536 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c94cf87-0c66-49cc-aef9-b4f15a36935a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:46.976970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c94cf87-0c66-49cc-aef9-b4f15a36935a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:47.109613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9c94cf87-0c66-49cc-aef9-b4f15a36935a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:47.117538 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9c94cf87-0c66-49cc-aef9-b4f15a36935a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1501 microversion: 2.1 time: 0.153581 Jul 20 22:47:47.118110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 179/354] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:46 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:47.135658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4571d6d-8ce9-4a61-9410-159a7ca400a4"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:47:47.136713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:47.143827 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:47.144283 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:47.145096 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:47.145534 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:47.170164 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] HTTP exception thrown: Cannot 'attach_volume' instance ed11a51a-3574-43eb-a485-e6df2ded9fee while it is in vm_state rescued Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Request method failure captured: Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: POST /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee/os-volume_attachments HTTP/1.1 Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 74 Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWQRNS5QEz_nIx7JpWo3eYPJN2oyFpU7Oa8tzB_exObv7ffo-e51nONWbNwbw_pURsJUKw8Q9iXUPR0igSGfrFxGoD4dwenCxyjEfmDfXIFNCANufGETvsNlinmX78kKFdqLWyz0d4rSgkr5GWAaNPLzpYmmxW3UJtAqqDUqn7ZiCE Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:47:47.171821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_55c688e93c2b414ca86a3c2f9ec84798", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 1ed9249b2a9b42d9972ed71c04f2c888 Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {"volumeAttachment": {"volumeId": "a4571d6d-8ce9-4a61-9410-159a7ca400a4"}} Jul 20 22:47:47.173015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Cannot 'attach_volume' instance ed11a51a-3574-43eb-a485-e6df2ded9fee while it is in vm_state rescued Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'server_id': 'ed11a51a-3574-43eb-a485-e6df2ded9fee', 'body': {'volumeAttachment': {'volumeId': 'a4571d6d-8ce9-4a61-9410-159a7ca400a4'}}} Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed11a51a-3574-43eb-a485-e6df2ded9fee in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:47:47.173801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ed11a51a-3574-43eb-a485-e6df2ded9fee while it is in vm_state rescued Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:47:47.175000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:47:47.176836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:47:47.176836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:47:47.176836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ed11a51a-3574-43eb-a485-e6df2ded9fee while it is in vm_state rescued Jul 20 22:47:47.176836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:47:47.176836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Returning 409 to user: Cannot 'attach_volume' instance ed11a51a-3574-43eb-a485-e6df2ded9fee while it is in vm_state rescued {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:47:47.176836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7b2bbe58-fa0a-47e3-9bd9-1c1c409d35ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041880 Jul 20 22:47:47.176836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 176/355] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:47:47 2022] POST /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 22:47:47.182904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f1f80568-52c7-45f2-96c0-f0e306fb21e0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:47:47.183473 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f1f80568-52c7-45f2-96c0-f0e306fb21e0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:47.189734 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f1f80568-52c7-45f2-96c0-f0e306fb21e0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:47.190181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f1f80568-52c7-45f2-96c0-f0e306fb21e0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:47.190942 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f1f80568-52c7-45f2-96c0-f0e306fb21e0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:47.191429 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f1f80568-52c7-45f2-96c0-f0e306fb21e0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:47.436993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f1f80568-52c7-45f2-96c0-f0e306fb21e0 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee/action" status: 202 len: 0 microversion: 2.1 time: 0.257949 Jul 20 22:47:47.440218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 180/356] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:47:47 2022] POST /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:47:47.446716 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-745315ce-96a0-4b2c-adb8-be37696fd3c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:47.447346 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-745315ce-96a0-4b2c-adb8-be37696fd3c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:47.455139 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-745315ce-96a0-4b2c-adb8-be37696fd3c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:47.455575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-745315ce-96a0-4b2c-adb8-be37696fd3c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:47.456355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-745315ce-96a0-4b2c-adb8-be37696fd3c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:47.456802 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-745315ce-96a0-4b2c-adb8-be37696fd3c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:47.605967 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-745315ce-96a0-4b2c-adb8-be37696fd3c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:47.615163 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-745315ce-96a0-4b2c-adb8-be37696fd3c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1509 microversion: 2.1 time: 0.172782 Jul 20 22:47:47.619776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 177/357] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:47 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:47.835113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f31f5193-cd0b-47f3-bea4-f697b30fab7d tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe243fe0790>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:47.918597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f31f5193-cd0b-47f3-bea4-f697b30fab7d tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/ffcbbc72-140b-4439-9e69-e45a78db1d22" status: 200 len: 351 microversion: 2.1 time: 0.087615 Jul 20 22:47:47.919768 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 181/358] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:47:47 2022] GET /compute/v2.1/os-volumes/ffcbbc72-140b-4439-9e69-e45a78db1d22 => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:48.635226 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a8e33924-af13-44ee-b5f2-4dafb9b6a4be tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:48.635854 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a8e33924-af13-44ee-b5f2-4dafb9b6a4be tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:48.642806 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8e33924-af13-44ee-b5f2-4dafb9b6a4be tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:48.643270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8e33924-af13-44ee-b5f2-4dafb9b6a4be tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:48.644068 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8e33924-af13-44ee-b5f2-4dafb9b6a4be tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:48.644491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8e33924-af13-44ee-b5f2-4dafb9b6a4be tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:48.785168 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a8e33924-af13-44ee-b5f2-4dafb9b6a4be tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:48.793025 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a8e33924-af13-44ee-b5f2-4dafb9b6a4be tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1509 microversion: 2.1 time: 0.162446 Jul 20 22:47:48.793590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 178/359] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:48 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:49.811984 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b1beed21-4eb9-4681-8dfd-f858c5a01897 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:49.812700 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b1beed21-4eb9-4681-8dfd-f858c5a01897 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:49.819053 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b1beed21-4eb9-4681-8dfd-f858c5a01897 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:49.819497 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b1beed21-4eb9-4681-8dfd-f858c5a01897 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:49.820300 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b1beed21-4eb9-4681-8dfd-f858c5a01897 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:49.820737 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b1beed21-4eb9-4681-8dfd-f858c5a01897 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:49.957515 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b1beed21-4eb9-4681-8dfd-f858c5a01897 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:49.965631 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b1beed21-4eb9-4681-8dfd-f858c5a01897 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1509 microversion: 2.1 time: 0.158568 Jul 20 22:47:49.973329 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 182/360] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:49 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:50.701383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-68e5fd68-95ee-443e-84f5-53a106a81459 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe2500f8040>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:50.750351 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-68e5fd68-95ee-443e-84f5-53a106a81459 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/8481c393-6e03-44bf-91f4-a08bdfdecc46" status: 200 len: 350 microversion: 2.1 time: 0.053116 Jul 20 22:47:50.750939 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 179/361] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:47:50 2022] GET /compute/v2.1/os-volumes/8481c393-6e03-44bf-91f4-a08bdfdecc46 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:50.983235 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-70ccdc9e-1120-4fb3-b118-7a1f183cd5b5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:50.983959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-70ccdc9e-1120-4fb3-b118-7a1f183cd5b5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:50.990375 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-70ccdc9e-1120-4fb3-b118-7a1f183cd5b5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:50.990844 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-70ccdc9e-1120-4fb3-b118-7a1f183cd5b5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:50.991746 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-70ccdc9e-1120-4fb3-b118-7a1f183cd5b5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:50.992178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-70ccdc9e-1120-4fb3-b118-7a1f183cd5b5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:51.124770 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-70ccdc9e-1120-4fb3-b118-7a1f183cd5b5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:51.132453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-70ccdc9e-1120-4fb3-b118-7a1f183cd5b5 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1509 microversion: 2.1 time: 0.153245 Jul 20 22:47:51.133007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 183/362] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:50 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:52.150277 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9e326c05-5b33-45ce-84b5-2da2724f7631 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:52.151197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9e326c05-5b33-45ce-84b5-2da2724f7631 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:47:52.158345 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9e326c05-5b33-45ce-84b5-2da2724f7631 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:52.158910 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9e326c05-5b33-45ce-84b5-2da2724f7631 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:52.159610 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9e326c05-5b33-45ce-84b5-2da2724f7631 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:47:52.160608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9e326c05-5b33-45ce-84b5-2da2724f7631 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:47:52.319489 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9e326c05-5b33-45ce-84b5-2da2724f7631 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:47:52.328198 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9e326c05-5b33-45ce-84b5-2da2724f7631 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1515 microversion: 2.1 time: 0.182070 Jul 20 22:47:52.328766 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 180/363] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:47:52 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:53.787396 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cff06143-7b74-4e84-bb3c-2c4af12b7b10 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe243fe53a0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:53.835365 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cff06143-7b74-4e84-bb3c-2c4af12b7b10 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/27b39b19-22bd-4795-b057-77682db1e5d1" status: 200 len: 351 microversion: 2.1 time: 0.051563 Jul 20 22:47:53.835940 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 184/364] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:47:53 2022] GET /compute/v2.1/os-volumes/27b39b19-22bd-4795-b057-77682db1e5d1 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:53.851403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9b7a7bb4-ee6d-4d4d-b8f3-afbf5ba24c6e tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe250108d30>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:53.932383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9b7a7bb4-ee6d-4d4d-b8f3-afbf5ba24c6e tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084742 Jul 20 22:47:53.933027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 181/365] 10.222.0.81 () {58 vars in 1133 bytes} [Wed Jul 20 22:47:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:53.944836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d919010b-aae4-472b-be84-5ece675867bd tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe25024ee50>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:54.024708 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d919010b-aae4-472b-be84-5ece675867bd tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083513 Jul 20 22:47:54.025269 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 185/366] 10.222.0.81 () {58 vars in 1148 bytes} [Wed Jul 20 22:47:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:54.037470 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-29708974-0e8a-450b-868d-6465abe2cc89 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe243fd3ca0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:54.117059 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-29708974-0e8a-450b-868d-6465abe2cc89 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083256 Jul 20 22:47:54.117651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 182/367] 10.222.0.81 () {58 vars in 1133 bytes} [Wed Jul 20 22:47:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:54.128390 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d4d0965a-a669-4142-9485-f5b74fbed4fa tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe251cfdca0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:54.210703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d4d0965a-a669-4142-9485-f5b74fbed4fa tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085888 Jul 20 22:47:54.211327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 186/368] 10.222.0.81 () {58 vars in 1166 bytes} [Wed Jul 20 22:47:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:54.223236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-31bbd0ac-980f-4ed2-85b9-e8372dafb826 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe243fd85e0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:54.304575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-31bbd0ac-980f-4ed2-85b9-e8372dafb826 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085078 Jul 20 22:47:54.305390 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 183/369] 10.222.0.81 () {58 vars in 1169 bytes} [Wed Jul 20 22:47:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:54.316921 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-90683d1a-c1c2-42bc-a39d-df9a4d99aae8 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe243fc78b0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:54.396678 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-90683d1a-c1c2-42bc-a39d-df9a4d99aae8 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083449 Jul 20 22:47:54.397279 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 187/370] 10.222.0.81 () {58 vars in 1154 bytes} [Wed Jul 20 22:47:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:47:54.409097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e3504841-d95f-4a1c-be84-bf78ac38a611 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe250052430>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:54.486716 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e3504841-d95f-4a1c-be84-bf78ac38a611 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081557 Jul 20 22:47:54.487358 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 184/371] 10.222.0.81 () {58 vars in 1187 bytes} [Wed Jul 20 22:47:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:47:54.499170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3509f336-2a2e-4868-ac32-d1a7b955db05 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] Calling method '.version_select at 0x7fe243fe5310>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:47:54.579572 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3509f336-2a2e-4868-ac32-d1a7b955db05 tempest-VolumesTestJSON-1977638888 tempest-VolumesTestJSON-1977638888-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084533 Jul 20 22:47:54.580138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 188/372] 10.222.0.81 () {58 vars in 1154 bytes} [Wed Jul 20 22:47:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:01.343089 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3e55bac9-848c-43bc-a1fc-d7cdf3eeb0ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'create', calling method: .version_select at 0x7fe25015b160>, body: {"keypair": {"name": "tempest-keypair-1332304509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBfneqKTn4t8GKoYcn165AY3KxYDz5ca+VbZ34V6ZyUizyQRqdFfNmLFjEoqvRbo7dNLdnSJSVgg2l0Ze0XYX6tnl/7j2KEw79coH0iBYZ0tRUhX/vFVljSNwi8J3ut7w=="}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:48:01.346943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:01.358880 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-3e55bac9-848c-43bc-a1fc-d7cdf3eeb0ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Getting quotas for project 55c688e93c2b414ca86a3c2f9ec84798. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:48:01.362815 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-3e55bac9-848c-43bc-a1fc-d7cdf3eeb0ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Getting quotas for user 1ed9249b2a9b42d9972ed71c04f2c888 and project 55c688e93c2b414ca86a3c2f9ec84798. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:48:01.485219 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3e55bac9-848c-43bc-a1fc-d7cdf3eeb0ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146549 Jul 20 22:48:01.485820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 185/373] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 22:48:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:48:04.017158 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=23 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:04.018070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:04.023397 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2127814414", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efcbc23a-538d-4e8a-a0a8-c637f267412a"}], "security_groups": [{"name": "tempest-securitygroup--956894565"}], "key_name": "tempest-keypair-1332304509", "user_data": "}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:48:04.124723 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] validate_networks() for [('efcbc23a-538d-4e8a-a0a8-c637f267412a', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:48:04.731662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:48:04.732059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:48:04.732605 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:48:04.732939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:48:04.733389 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:48:04.742728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:04.743216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:04.744016 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:04.744642 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:04.761819 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Getting quotas for project 55c688e93c2b414ca86a3c2f9ec84798. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:48:04.765773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Getting quotas for user 1ed9249b2a9b42d9972ed71c04f2c888 and project 55c688e93c2b414ca86a3c2f9ec84798. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:48:04.776876 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:48:04.779132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:48:04.915663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-75d8a3d7-1390-4e7b-a8c9-9982f9882914 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.899130 Jul 20 22:48:04.916600 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 189/374] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:48:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:48:04.923228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=24 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:04.928251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-af751fef-9117-4462-961a-047617f6a61e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:04.928859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-af751fef-9117-4462-961a-047617f6a61e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:04.983558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-af751fef-9117-4462-961a-047617f6a61e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:04.997721 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-af751fef-9117-4462-961a-047617f6a61e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1246 microversion: 2.1 time: 0.068510 Jul 20 22:48:04.997721 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 186/375] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:04 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:06.009079 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ae968616-c00e-43c4-9dd8-382ce11e2572 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:06.010152 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ae968616-c00e-43c4-9dd8-382ce11e2572 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:06.064886 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ae968616-c00e-43c4-9dd8-382ce11e2572 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:06.071574 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ae968616-c00e-43c4-9dd8-382ce11e2572 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1246 microversion: 2.1 time: 0.067509 Jul 20 22:48:06.072332 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 190/376] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:06 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:07.089637 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-88044346-8092-449d-91bc-45c11857e701 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:07.090377 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-88044346-8092-449d-91bc-45c11857e701 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:07.097439 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88044346-8092-449d-91bc-45c11857e701 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:07.097886 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88044346-8092-449d-91bc-45c11857e701 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:07.098699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88044346-8092-449d-91bc-45c11857e701 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:07.099164 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88044346-8092-449d-91bc-45c11857e701 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:07.180896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-88044346-8092-449d-91bc-45c11857e701 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:07.195039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-88044346-8092-449d-91bc-45c11857e701 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1298 microversion: 2.1 time: 0.109517 Jul 20 22:48:07.195863 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 187/377] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:07 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:08.216546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b4577a4b-5f6c-400e-b0e2-c4fbb93360ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:08.217180 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b4577a4b-5f6c-400e-b0e2-c4fbb93360ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:08.223472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b4577a4b-5f6c-400e-b0e2-c4fbb93360ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:08.223931 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b4577a4b-5f6c-400e-b0e2-c4fbb93360ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:08.224701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b4577a4b-5f6c-400e-b0e2-c4fbb93360ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:08.225137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b4577a4b-5f6c-400e-b0e2-c4fbb93360ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:08.306620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b4577a4b-5f6c-400e-b0e2-c4fbb93360ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:08.309387 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b4577a4b-5f6c-400e-b0e2-c4fbb93360ae tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1304 microversion: 2.1 time: 0.096752 Jul 20 22:48:08.312658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 191/378] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:08 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:09.339908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5be92f5e-2bd6-4456-8f4f-c00c37348eab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:09.343187 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5be92f5e-2bd6-4456-8f4f-c00c37348eab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:09.363383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5be92f5e-2bd6-4456-8f4f-c00c37348eab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:09.364091 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5be92f5e-2bd6-4456-8f4f-c00c37348eab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:09.365097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5be92f5e-2bd6-4456-8f4f-c00c37348eab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:09.365690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5be92f5e-2bd6-4456-8f4f-c00c37348eab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:09.531933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5be92f5e-2bd6-4456-8f4f-c00c37348eab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:09.540465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5be92f5e-2bd6-4456-8f4f-c00c37348eab tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.205168 Jul 20 22:48:09.541214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 188/379] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:09 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:09.625945 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-5a64da3e-bfcc-4e0a-9a64-681437b61df9 req-2a71ff5d-149a-442a-8d1a-1f9c5b1759c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87967be5-1f31-4e6c-afe0-f3c63923c558", "tag": "6cedd83c-eef6-4869-997c-997862003129"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:48:09.636767 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5a64da3e-bfcc-4e0a-9a64-681437b61df9 req-2a71ff5d-149a-442a-8d1a-1f9c5b1759c6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:09.637431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5a64da3e-bfcc-4e0a-9a64-681437b61df9 req-2a71ff5d-149a-442a-8d1a-1f9c5b1759c6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:09.659095 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-5a64da3e-bfcc-4e0a-9a64-681437b61df9 req-2a71ff5d-149a-442a-8d1a-1f9c5b1759c6 service nova] Creating event network-changed:6cedd83c-eef6-4869-997c-997862003129 for instance 87967be5-1f31-4e6c-afe0-f3c63923c558 on hv-cinder-79987 Jul 20 22:48:09.664904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-5a64da3e-bfcc-4e0a-9a64-681437b61df9 req-2a71ff5d-149a-442a-8d1a-1f9c5b1759c6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044276 Jul 20 22:48:09.665511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 192/380] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:48:10.557797 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3b0ced8f-b8f1-4b41-a162-83cc729ee180 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:10.558400 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3b0ced8f-b8f1-4b41-a162-83cc729ee180 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:10.564631 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3b0ced8f-b8f1-4b41-a162-83cc729ee180 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:10.565070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3b0ced8f-b8f1-4b41-a162-83cc729ee180 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:10.565820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3b0ced8f-b8f1-4b41-a162-83cc729ee180 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:10.566287 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3b0ced8f-b8f1-4b41-a162-83cc729ee180 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:10.708215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3b0ced8f-b8f1-4b41-a162-83cc729ee180 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:10.715553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3b0ced8f-b8f1-4b41-a162-83cc729ee180 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.161737 Jul 20 22:48:10.716121 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 189/381] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:10 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:11.733736 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8d3b65a1-aca6-4944-a068-5743ec29e449 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:11.734596 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8d3b65a1-aca6-4944-a068-5743ec29e449 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:11.741922 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d3b65a1-aca6-4944-a068-5743ec29e449 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:11.742467 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d3b65a1-aca6-4944-a068-5743ec29e449 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:11.743270 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d3b65a1-aca6-4944-a068-5743ec29e449 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:11.743704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d3b65a1-aca6-4944-a068-5743ec29e449 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:11.887646 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8d3b65a1-aca6-4944-a068-5743ec29e449 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:11.896109 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8d3b65a1-aca6-4944-a068-5743ec29e449 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.166704 Jul 20 22:48:11.896677 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 193/382] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:11 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:12.913593 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-dd1c563f-9ee5-45d4-a78b-f3b78fa5d6b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:12.914125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-dd1c563f-9ee5-45d4-a78b-f3b78fa5d6b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:12.920850 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dd1c563f-9ee5-45d4-a78b-f3b78fa5d6b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:12.931806 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dd1c563f-9ee5-45d4-a78b-f3b78fa5d6b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:12.931806 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dd1c563f-9ee5-45d4-a78b-f3b78fa5d6b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:12.931806 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dd1c563f-9ee5-45d4-a78b-f3b78fa5d6b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:13.072325 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-dd1c563f-9ee5-45d4-a78b-f3b78fa5d6b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:13.080054 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-dd1c563f-9ee5-45d4-a78b-f3b78fa5d6b2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.171194 Jul 20 22:48:13.084361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 190/383] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:12 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:14.098257 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9c10536e-6338-4a61-901f-450a45ac1f98 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:14.098866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9c10536e-6338-4a61-901f-450a45ac1f98 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:14.105009 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c10536e-6338-4a61-901f-450a45ac1f98 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:14.105454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c10536e-6338-4a61-901f-450a45ac1f98 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:14.106255 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c10536e-6338-4a61-901f-450a45ac1f98 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:14.106685 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c10536e-6338-4a61-901f-450a45ac1f98 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:14.248444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9c10536e-6338-4a61-901f-450a45ac1f98 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:14.255844 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9c10536e-6338-4a61-901f-450a45ac1f98 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.162026 Jul 20 22:48:14.257527 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 194/384] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:14 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:15.272476 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4a0fb0c9-364d-4ed2-9006-c403d9ebe6b1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:15.273094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4a0fb0c9-364d-4ed2-9006-c403d9ebe6b1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:15.275454 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=6 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:15.281397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4a0fb0c9-364d-4ed2-9006-c403d9ebe6b1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:15.281935 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4a0fb0c9-364d-4ed2-9006-c403d9ebe6b1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:15.282781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4a0fb0c9-364d-4ed2-9006-c403d9ebe6b1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:15.283341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4a0fb0c9-364d-4ed2-9006-c403d9ebe6b1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:15.423712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4a0fb0c9-364d-4ed2-9006-c403d9ebe6b1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:15.431706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4a0fb0c9-364d-4ed2-9006-c403d9ebe6b1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.162956 Jul 20 22:48:15.432274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 191/385] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:15 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:16.448751 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6ac8b873-89f9-472f-9822-6133770c7d4b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:16.449388 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6ac8b873-89f9-472f-9822-6133770c7d4b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:16.451408 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:16.452020 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=8 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:16.457112 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6ac8b873-89f9-472f-9822-6133770c7d4b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:16.457626 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6ac8b873-89f9-472f-9822-6133770c7d4b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:16.462549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6ac8b873-89f9-472f-9822-6133770c7d4b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:16.462549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6ac8b873-89f9-472f-9822-6133770c7d4b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:16.590955 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6ac8b873-89f9-472f-9822-6133770c7d4b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:16.599392 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6ac8b873-89f9-472f-9822-6133770c7d4b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.154420 Jul 20 22:48:16.600287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 195/386] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:16 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:17.615461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8a65775a-7bd8-4e13-8483-c6833616c0c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:17.616076 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8a65775a-7bd8-4e13-8483-c6833616c0c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:17.622692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8a65775a-7bd8-4e13-8483-c6833616c0c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:17.623170 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8a65775a-7bd8-4e13-8483-c6833616c0c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:17.636230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8a65775a-7bd8-4e13-8483-c6833616c0c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:17.636230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8a65775a-7bd8-4e13-8483-c6833616c0c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:17.735506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-6c5bfd6e-6c67-4109-8971-ea3f8cf6874d req-d64025ab-a801-44fb-acb6-4897b389dbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87967be5-1f31-4e6c-afe0-f3c63923c558", "name": "network-vif-plugged", "status": "completed", "tag": "6cedd83c-eef6-4869-997c-997862003129"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:48:17.747234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-6c5bfd6e-6c67-4109-8971-ea3f8cf6874d req-d64025ab-a801-44fb-acb6-4897b389dbb6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:17.747678 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-6c5bfd6e-6c67-4109-8971-ea3f8cf6874d req-d64025ab-a801-44fb-acb6-4897b389dbb6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:17.761081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-6c5bfd6e-6c67-4109-8971-ea3f8cf6874d req-d64025ab-a801-44fb-acb6-4897b389dbb6 service nova] Creating event network-vif-plugged:6cedd83c-eef6-4869-997c-997862003129 for instance 87967be5-1f31-4e6c-afe0-f3c63923c558 on hv-cinder-79987 Jul 20 22:48:17.766654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-6c5bfd6e-6c67-4109-8971-ea3f8cf6874d req-d64025ab-a801-44fb-acb6-4897b389dbb6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035791 Jul 20 22:48:17.768010 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 196/387] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:48:17.781062 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8a65775a-7bd8-4e13-8483-c6833616c0c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:17.789415 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8a65775a-7bd8-4e13-8483-c6833616c0c4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.177691 Jul 20 22:48:17.790085 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 192/388] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:17 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:18.807432 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9ff4913b-94ff-4ece-b6d9-e593c05bd494 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:18.808188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9ff4913b-94ff-4ece-b6d9-e593c05bd494 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:18.814430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9ff4913b-94ff-4ece-b6d9-e593c05bd494 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:18.814919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9ff4913b-94ff-4ece-b6d9-e593c05bd494 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:18.815652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9ff4913b-94ff-4ece-b6d9-e593c05bd494 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:18.816084 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9ff4913b-94ff-4ece-b6d9-e593c05bd494 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:18.946540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9ff4913b-94ff-4ece-b6d9-e593c05bd494 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:18.954361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9ff4913b-94ff-4ece-b6d9-e593c05bd494 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.151034 Jul 20 22:48:18.954920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 197/389] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:18 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:19.971765 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7cee9a16-7e3a-491c-83c8-d881c1bf9309 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:19.972381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7cee9a16-7e3a-491c-83c8-d881c1bf9309 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:19.978711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7cee9a16-7e3a-491c-83c8-d881c1bf9309 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:19.979201 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7cee9a16-7e3a-491c-83c8-d881c1bf9309 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:19.980012 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7cee9a16-7e3a-491c-83c8-d881c1bf9309 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:19.980479 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7cee9a16-7e3a-491c-83c8-d881c1bf9309 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:20.121314 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7cee9a16-7e3a-491c-83c8-d881c1bf9309 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:20.128698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7cee9a16-7e3a-491c-83c8-d881c1bf9309 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.160769 Jul 20 22:48:20.129260 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 193/390] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:19 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:21.146125 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f4f64102-135e-4dc7-98e2-24da0d1af25d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:21.146796 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f4f64102-135e-4dc7-98e2-24da0d1af25d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:21.154087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f4f64102-135e-4dc7-98e2-24da0d1af25d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:21.154536 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f4f64102-135e-4dc7-98e2-24da0d1af25d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:21.155345 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f4f64102-135e-4dc7-98e2-24da0d1af25d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:21.155780 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f4f64102-135e-4dc7-98e2-24da0d1af25d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:21.290938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f4f64102-135e-4dc7-98e2-24da0d1af25d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:21.298601 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f4f64102-135e-4dc7-98e2-24da0d1af25d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.156799 Jul 20 22:48:21.299499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 198/391] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:21 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:22.315968 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3983c97a-7da5-4ede-a665-eed8c305fe0b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:22.316487 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3983c97a-7da5-4ede-a665-eed8c305fe0b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:22.322929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3983c97a-7da5-4ede-a665-eed8c305fe0b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:22.323406 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3983c97a-7da5-4ede-a665-eed8c305fe0b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:22.324167 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3983c97a-7da5-4ede-a665-eed8c305fe0b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:22.324602 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3983c97a-7da5-4ede-a665-eed8c305fe0b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:22.459059 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3983c97a-7da5-4ede-a665-eed8c305fe0b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:22.466364 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3983c97a-7da5-4ede-a665-eed8c305fe0b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.154347 Jul 20 22:48:22.467029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 194/392] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:22 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:23.484677 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-26671d5a-678a-433a-8717-ff961e4cd821 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:23.485279 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-26671d5a-678a-433a-8717-ff961e4cd821 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:23.491445 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-26671d5a-678a-433a-8717-ff961e4cd821 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:23.491968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-26671d5a-678a-433a-8717-ff961e4cd821 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:23.492732 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-26671d5a-678a-433a-8717-ff961e4cd821 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:23.493159 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-26671d5a-678a-433a-8717-ff961e4cd821 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:23.623226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-26671d5a-678a-433a-8717-ff961e4cd821 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:23.631483 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-26671d5a-678a-433a-8717-ff961e4cd821 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.150595 Jul 20 22:48:23.632058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 199/393] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:23 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:24.649473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0399b835-e70c-48ac-b540-a0a9cc78f32f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:24.650075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0399b835-e70c-48ac-b540-a0a9cc78f32f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:24.656893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0399b835-e70c-48ac-b540-a0a9cc78f32f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:24.657337 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0399b835-e70c-48ac-b540-a0a9cc78f32f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:24.658087 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0399b835-e70c-48ac-b540-a0a9cc78f32f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:24.658518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0399b835-e70c-48ac-b540-a0a9cc78f32f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:24.794946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0399b835-e70c-48ac-b540-a0a9cc78f32f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:24.803286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0399b835-e70c-48ac-b540-a0a9cc78f32f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.158123 Jul 20 22:48:24.804119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 195/394] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:24 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:25.820901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8b023f2a-e46e-40e8-b07c-1ebb513f628f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:25.821504 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8b023f2a-e46e-40e8-b07c-1ebb513f628f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:25.827798 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8b023f2a-e46e-40e8-b07c-1ebb513f628f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:25.828243 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8b023f2a-e46e-40e8-b07c-1ebb513f628f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:25.829044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8b023f2a-e46e-40e8-b07c-1ebb513f628f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:25.829475 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8b023f2a-e46e-40e8-b07c-1ebb513f628f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:25.961885 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8b023f2a-e46e-40e8-b07c-1ebb513f628f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:25.969357 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8b023f2a-e46e-40e8-b07c-1ebb513f628f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.152268 Jul 20 22:48:25.969909 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 200/395] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:25 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:26.985555 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3bca21b8-de97-4536-9941-2d6b9d36f2d7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:26.986157 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3bca21b8-de97-4536-9941-2d6b9d36f2d7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:26.992783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3bca21b8-de97-4536-9941-2d6b9d36f2d7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:26.993224 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3bca21b8-de97-4536-9941-2d6b9d36f2d7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:26.993984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3bca21b8-de97-4536-9941-2d6b9d36f2d7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:26.994430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3bca21b8-de97-4536-9941-2d6b9d36f2d7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:27.124398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3bca21b8-de97-4536-9941-2d6b9d36f2d7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:27.131823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3bca21b8-de97-4536-9941-2d6b9d36f2d7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.150118 Jul 20 22:48:27.132381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 196/396] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:26 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:28.148433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c9f3999f-3513-40fd-9c28-a2bb0c2c269a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:28.149034 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c9f3999f-3513-40fd-9c28-a2bb0c2c269a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:28.155382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9f3999f-3513-40fd-9c28-a2bb0c2c269a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:28.155823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9f3999f-3513-40fd-9c28-a2bb0c2c269a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:28.156572 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9f3999f-3513-40fd-9c28-a2bb0c2c269a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:28.157077 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9f3999f-3513-40fd-9c28-a2bb0c2c269a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:28.290593 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c9f3999f-3513-40fd-9c28-a2bb0c2c269a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:28.298308 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c9f3999f-3513-40fd-9c28-a2bb0c2c269a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.153717 Jul 20 22:48:28.301235 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 201/397] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:28 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:29.315295 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cbe43ac4-ac19-4d89-a9a2-5aa2dd7cff97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:29.315899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cbe43ac4-ac19-4d89-a9a2-5aa2dd7cff97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:29.322496 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cbe43ac4-ac19-4d89-a9a2-5aa2dd7cff97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:29.322937 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cbe43ac4-ac19-4d89-a9a2-5aa2dd7cff97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:29.323752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cbe43ac4-ac19-4d89-a9a2-5aa2dd7cff97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:29.324184 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cbe43ac4-ac19-4d89-a9a2-5aa2dd7cff97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:29.453385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cbe43ac4-ac19-4d89-a9a2-5aa2dd7cff97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:29.461290 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cbe43ac4-ac19-4d89-a9a2-5aa2dd7cff97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.149998 Jul 20 22:48:29.461919 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 197/398] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:29 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:30.477753 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-93c912a9-ef34-4e68-880e-60528997918e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:30.494623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-93c912a9-ef34-4e68-880e-60528997918e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:30.494623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-93c912a9-ef34-4e68-880e-60528997918e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:30.494623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-93c912a9-ef34-4e68-880e-60528997918e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:30.494623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-93c912a9-ef34-4e68-880e-60528997918e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:30.495187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-93c912a9-ef34-4e68-880e-60528997918e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:30.620069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-93c912a9-ef34-4e68-880e-60528997918e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:30.627526 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-93c912a9-ef34-4e68-880e-60528997918e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.153864 Jul 20 22:48:30.628094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 202/399] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:30 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:31.644283 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-778d0718-7234-4454-b811-5c47ae048857 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:31.644927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-778d0718-7234-4454-b811-5c47ae048857 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:31.651419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-778d0718-7234-4454-b811-5c47ae048857 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:31.651868 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-778d0718-7234-4454-b811-5c47ae048857 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:31.652629 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-778d0718-7234-4454-b811-5c47ae048857 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:31.653063 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-778d0718-7234-4454-b811-5c47ae048857 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:31.788943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-778d0718-7234-4454-b811-5c47ae048857 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:31.798382 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-778d0718-7234-4454-b811-5c47ae048857 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1371 microversion: 2.1 time: 0.157916 Jul 20 22:48:31.798999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 198/400] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:31 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:48:32.816155 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-76445f49-379c-41f3-abd4-4d2cdac8c16a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:32.816793 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-76445f49-379c-41f3-abd4-4d2cdac8c16a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:32.823477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-76445f49-379c-41f3-abd4-4d2cdac8c16a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:32.823919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-76445f49-379c-41f3-abd4-4d2cdac8c16a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:32.824770 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-76445f49-379c-41f3-abd4-4d2cdac8c16a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:32.825263 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-76445f49-379c-41f3-abd4-4d2cdac8c16a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:32.959582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-76445f49-379c-41f3-abd4-4d2cdac8c16a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:48:32.967988 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-76445f49-379c-41f3-abd4-4d2cdac8c16a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1565 microversion: 2.1 time: 0.155732 Jul 20 22:48:32.968823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 203/401] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:48:32 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:48:32.983900 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0a605793-860f-4694-b092-6056a13783ca tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:48:32.984400 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0a605793-860f-4694-b092-6056a13783ca tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:48:32.991264 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a605793-860f-4694-b092-6056a13783ca tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:33.000387 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a605793-860f-4694-b092-6056a13783ca tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:33.000387 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a605793-860f-4694-b092-6056a13783ca tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:33.000387 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a605793-860f-4694-b092-6056a13783ca tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:33.072009 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0a605793-860f-4694-b092-6056a13783ca tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091846 Jul 20 22:48:33.072860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 199/402] 10.222.0.81 () {58 vars in 1274 bytes} [Wed Jul 20 22:48:32 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:48:34.469867 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-4030956d-733b-4ecc-96d7-21ab83536f33 req-4c1f0165-4c1e-4252-867c-3a32ca296346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87967be5-1f31-4e6c-afe0-f3c63923c558", "tag": "6cedd83c-eef6-4869-997c-997862003129"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:48:34.474052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:34.479369 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-4030956d-733b-4ecc-96d7-21ab83536f33 req-4c1f0165-4c1e-4252-867c-3a32ca296346 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:48:34.480031 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-4030956d-733b-4ecc-96d7-21ab83536f33 req-4c1f0165-4c1e-4252-867c-3a32ca296346 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:48:34.490995 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-4030956d-733b-4ecc-96d7-21ab83536f33 req-4c1f0165-4c1e-4252-867c-3a32ca296346 service nova] Creating event network-changed:6cedd83c-eef6-4869-997c-997862003129 for instance 87967be5-1f31-4e6c-afe0-f3c63923c558 on hv-cinder-79987 Jul 20 22:48:34.496208 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-4030956d-733b-4ecc-96d7-21ab83536f33 req-4c1f0165-4c1e-4252-867c-3a32ca296346 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029975 Jul 20 22:48:34.496790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 204/403] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:49:01.226606 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:49:01.227197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 22:49:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:49:01.376644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:49:01.377092 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 22:49:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:49:09.730849 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:09.731792 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=76 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:09.735884 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-186268017", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "networks": [{"uuid": "25cdff7d-27ed-4136-8183-3055182fbcc3"}]}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:49:09.791354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] validate_networks() for [('25cdff7d-27ed-4136-8183-3055182fbcc3', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:49:10.176787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:49:10.177738 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:49:10.178249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:49:10.178657 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:49:10.179710 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:49:10.191582 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:10.196503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:10.196503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:10.196503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:10.210691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Getting quotas for project 650d54a3145d42748ed81457cdd1eb34. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:49:10.214781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Getting quotas for user 1f237b9adae24d1ca2262d89eb000de4 and project 650d54a3145d42748ed81457cdd1eb34. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:49:10.226474 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:49:10.228786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:49:10.529333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-940b42d2-0d1c-4c44-a735-14e6976b11ae tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799731 Jul 20 22:49:10.529981 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 200/404] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:49:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:49:10.541471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4af1a800-3a4b-4fbc-8c90-ce131b60d0b9 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:10.542169 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4af1a800-3a4b-4fbc-8c90-ce131b60d0b9 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:10.544643 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=74 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.605511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4af1a800-3a4b-4fbc-8c90-ce131b60d0b9 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:10.612858 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4af1a800-3a4b-4fbc-8c90-ce131b60d0b9 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1218 microversion: 2.1 time: 0.075871 Jul 20 22:49:10.613405 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 205/405] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:10 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:11.631265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-33652e02-ba78-4c22-bea2-72c39c063184 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:11.631917 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-33652e02-ba78-4c22-bea2-72c39c063184 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:11.686961 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-33652e02-ba78-4c22-bea2-72c39c063184 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:11.694834 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-33652e02-ba78-4c22-bea2-72c39c063184 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1218 microversion: 2.1 time: 0.069014 Jul 20 22:49:11.698202 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 201/406] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:11 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:12.712906 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1615cba3-06c7-4fa6-a93b-ccf92e9ced8c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:12.713451 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1615cba3-06c7-4fa6-a93b-ccf92e9ced8c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:12.720218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1615cba3-06c7-4fa6-a93b-ccf92e9ced8c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:12.720664 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1615cba3-06c7-4fa6-a93b-ccf92e9ced8c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:12.722051 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1615cba3-06c7-4fa6-a93b-ccf92e9ced8c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:12.722565 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1615cba3-06c7-4fa6-a93b-ccf92e9ced8c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:13.010145 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1615cba3-06c7-4fa6-a93b-ccf92e9ced8c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:13.021854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1615cba3-06c7-4fa6-a93b-ccf92e9ced8c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1222 microversion: 2.1 time: 0.312786 Jul 20 22:49:13.022057 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 206/407] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:12 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1222 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:14.039686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f6ff29d4-f285-4110-aa97-1b6e80fa264c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:14.040453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f6ff29d4-f285-4110-aa97-1b6e80fa264c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:14.047235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f6ff29d4-f285-4110-aa97-1b6e80fa264c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:14.047786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f6ff29d4-f285-4110-aa97-1b6e80fa264c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:14.048681 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f6ff29d4-f285-4110-aa97-1b6e80fa264c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:14.049994 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f6ff29d4-f285-4110-aa97-1b6e80fa264c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:14.113220 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f6ff29d4-f285-4110-aa97-1b6e80fa264c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:14.120582 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f6ff29d4-f285-4110-aa97-1b6e80fa264c tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1214 microversion: 2.1 time: 0.085201 Jul 20 22:49:14.121127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 202/408] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:14 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:15.139894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2b04c73c-6f2b-4756-b453-6bda17b6a116 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:15.140604 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2b04c73c-6f2b-4756-b453-6bda17b6a116 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:15.146879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2b04c73c-6f2b-4756-b453-6bda17b6a116 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:15.147359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2b04c73c-6f2b-4756-b453-6bda17b6a116 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:15.154201 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2b04c73c-6f2b-4756-b453-6bda17b6a116 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:15.154201 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2b04c73c-6f2b-4756-b453-6bda17b6a116 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:15.226220 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2b04c73c-6f2b-4756-b453-6bda17b6a116 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:15.233657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2b04c73c-6f2b-4756-b453-6bda17b6a116 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1288 microversion: 2.1 time: 0.099831 Jul 20 22:49:15.234224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 207/409] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:15 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:16.251836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-524c0e05-1ae5-439a-86c6-e375735c0f89 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:16.252812 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-524c0e05-1ae5-439a-86c6-e375735c0f89 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:16.260769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-524c0e05-1ae5-439a-86c6-e375735c0f89 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:16.261212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-524c0e05-1ae5-439a-86c6-e375735c0f89 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:16.261981 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-524c0e05-1ae5-439a-86c6-e375735c0f89 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:16.262404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-524c0e05-1ae5-439a-86c6-e375735c0f89 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:16.399665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-524c0e05-1ae5-439a-86c6-e375735c0f89 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:16.407580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-524c0e05-1ae5-439a-86c6-e375735c0f89 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.159941 Jul 20 22:49:16.408150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 203/410] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:16 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:16.709222 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-c9224f17-a22c-4e2e-8556-7f5993a89ad7 req-7914ff67-ac90-466b-a6d1-d0f3720b2f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3cf5eb-8305-465f-8390-e522c61b12fe", "tag": "36e980b0-9ef6-40fd-8b37-e7269800c0dc"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:49:16.717261 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c9224f17-a22c-4e2e-8556-7f5993a89ad7 req-7914ff67-ac90-466b-a6d1-d0f3720b2f2b service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:16.717690 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c9224f17-a22c-4e2e-8556-7f5993a89ad7 req-7914ff67-ac90-466b-a6d1-d0f3720b2f2b service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:16.729725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-c9224f17-a22c-4e2e-8556-7f5993a89ad7 req-7914ff67-ac90-466b-a6d1-d0f3720b2f2b service nova] Creating event network-changed:36e980b0-9ef6-40fd-8b37-e7269800c0dc for instance 3f3cf5eb-8305-465f-8390-e522c61b12fe on hv-cinder-79987 Jul 20 22:49:16.734798 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-c9224f17-a22c-4e2e-8556-7f5993a89ad7 req-7914ff67-ac90-466b-a6d1-d0f3720b2f2b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030890 Jul 20 22:49:16.735489 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 208/411] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:49:17.425703 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c1466abc-83e5-4e3f-88e7-803ea0ff2786 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:17.426289 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c1466abc-83e5-4e3f-88e7-803ea0ff2786 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:17.432817 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c1466abc-83e5-4e3f-88e7-803ea0ff2786 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:17.433327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c1466abc-83e5-4e3f-88e7-803ea0ff2786 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:17.434107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c1466abc-83e5-4e3f-88e7-803ea0ff2786 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:17.434540 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c1466abc-83e5-4e3f-88e7-803ea0ff2786 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:17.569450 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c1466abc-83e5-4e3f-88e7-803ea0ff2786 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:17.576883 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c1466abc-83e5-4e3f-88e7-803ea0ff2786 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.155675 Jul 20 22:49:17.577443 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 204/412] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:17 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:18.593971 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e15db67d-5cdc-4774-8b74-ae3395e76a47 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:18.594667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e15db67d-5cdc-4774-8b74-ae3395e76a47 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:18.601558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e15db67d-5cdc-4774-8b74-ae3395e76a47 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:18.602003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e15db67d-5cdc-4774-8b74-ae3395e76a47 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:18.602758 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e15db67d-5cdc-4774-8b74-ae3395e76a47 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:18.603240 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e15db67d-5cdc-4774-8b74-ae3395e76a47 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:18.764689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e15db67d-5cdc-4774-8b74-ae3395e76a47 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:18.772699 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e15db67d-5cdc-4774-8b74-ae3395e76a47 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.182862 Jul 20 22:49:18.773342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 209/413] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:18 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:19.790355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-28673799-9446-46df-a4a3-c27d1fa00dac tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:19.790968 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-28673799-9446-46df-a4a3-c27d1fa00dac tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:19.797647 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-28673799-9446-46df-a4a3-c27d1fa00dac tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:19.798315 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-28673799-9446-46df-a4a3-c27d1fa00dac tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:19.799169 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-28673799-9446-46df-a4a3-c27d1fa00dac tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:19.800109 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-28673799-9446-46df-a4a3-c27d1fa00dac tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:19.937457 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-28673799-9446-46df-a4a3-c27d1fa00dac tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:19.945048 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-28673799-9446-46df-a4a3-c27d1fa00dac tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.158904 Jul 20 22:49:19.945639 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 205/414] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:19 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:20.962509 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cbeaccf2-926a-4741-a430-98fed1173407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:20.963835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cbeaccf2-926a-4741-a430-98fed1173407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:20.965781 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:20.971813 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cbeaccf2-926a-4741-a430-98fed1173407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:20.972333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cbeaccf2-926a-4741-a430-98fed1173407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:20.973590 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cbeaccf2-926a-4741-a430-98fed1173407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:20.974671 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cbeaccf2-926a-4741-a430-98fed1173407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:21.115558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cbeaccf2-926a-4741-a430-98fed1173407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:21.124644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cbeaccf2-926a-4741-a430-98fed1173407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.165379 Jul 20 22:49:21.124644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 210/415] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:20 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:22.142543 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c2cdbf04-98aa-4b88-b148-caf31416e233 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:22.143164 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c2cdbf04-98aa-4b88-b148-caf31416e233 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:22.145538 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:22.146756 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=8 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:22.151741 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c2cdbf04-98aa-4b88-b148-caf31416e233 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:22.152177 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c2cdbf04-98aa-4b88-b148-caf31416e233 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:22.153142 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c2cdbf04-98aa-4b88-b148-caf31416e233 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:22.153593 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c2cdbf04-98aa-4b88-b148-caf31416e233 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:22.282361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c2cdbf04-98aa-4b88-b148-caf31416e233 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:22.288860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c2cdbf04-98aa-4b88-b148-caf31416e233 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.150550 Jul 20 22:49:22.289422 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 206/416] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:22 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:23.306224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e01aee3e-ac47-4d37-96a9-c729d7035264 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:23.307557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e01aee3e-ac47-4d37-96a9-c729d7035264 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:23.314067 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e01aee3e-ac47-4d37-96a9-c729d7035264 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:23.314507 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e01aee3e-ac47-4d37-96a9-c729d7035264 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:23.315310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e01aee3e-ac47-4d37-96a9-c729d7035264 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:23.315894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e01aee3e-ac47-4d37-96a9-c729d7035264 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:23.456911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e01aee3e-ac47-4d37-96a9-c729d7035264 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:23.466061 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e01aee3e-ac47-4d37-96a9-c729d7035264 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.164025 Jul 20 22:49:23.466852 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 211/417] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:23 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:23.985195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-44327272-6bf0-4ee8-becd-1e3e31edfeb3 req-e7ef7b4a-c847-411b-a54c-cf0a040c492c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3cf5eb-8305-465f-8390-e522c61b12fe", "name": "network-vif-plugged", "status": "completed", "tag": "36e980b0-9ef6-40fd-8b37-e7269800c0dc"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:49:23.995100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-44327272-6bf0-4ee8-becd-1e3e31edfeb3 req-e7ef7b4a-c847-411b-a54c-cf0a040c492c service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:23.995594 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-44327272-6bf0-4ee8-becd-1e3e31edfeb3 req-e7ef7b4a-c847-411b-a54c-cf0a040c492c service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:24.015895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-44327272-6bf0-4ee8-becd-1e3e31edfeb3 req-e7ef7b4a-c847-411b-a54c-cf0a040c492c service nova] Creating event network-vif-plugged:36e980b0-9ef6-40fd-8b37-e7269800c0dc for instance 3f3cf5eb-8305-465f-8390-e522c61b12fe on hv-cinder-79987 Jul 20 22:49:24.021601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-44327272-6bf0-4ee8-becd-1e3e31edfeb3 req-e7ef7b4a-c847-411b-a54c-cf0a040c492c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040117 Jul 20 22:49:24.028418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 207/418] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:49:24.484274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d6dc7bff-4bde-4c43-98e5-dae89066d56d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:24.484874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d6dc7bff-4bde-4c43-98e5-dae89066d56d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:24.492696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d6dc7bff-4bde-4c43-98e5-dae89066d56d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:24.493136 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d6dc7bff-4bde-4c43-98e5-dae89066d56d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:24.493888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d6dc7bff-4bde-4c43-98e5-dae89066d56d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:24.494320 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d6dc7bff-4bde-4c43-98e5-dae89066d56d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:24.637814 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d6dc7bff-4bde-4c43-98e5-dae89066d56d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:24.645875 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d6dc7bff-4bde-4c43-98e5-dae89066d56d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.165317 Jul 20 22:49:24.646476 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 212/419] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:24 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:25.663815 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f6efbac5-131a-495a-80b2-6e859f5797ff tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:25.664517 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f6efbac5-131a-495a-80b2-6e859f5797ff tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:25.671038 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f6efbac5-131a-495a-80b2-6e859f5797ff tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:25.671497 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f6efbac5-131a-495a-80b2-6e859f5797ff tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:25.672264 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f6efbac5-131a-495a-80b2-6e859f5797ff tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:25.672698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f6efbac5-131a-495a-80b2-6e859f5797ff tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:25.807937 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f6efbac5-131a-495a-80b2-6e859f5797ff tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:25.815382 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f6efbac5-131a-495a-80b2-6e859f5797ff tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.156362 Jul 20 22:49:25.815947 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 208/420] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:25 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:26.748385 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f330dd26-7842-4109-a499-f4c0fa5f831d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:26.748940 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f330dd26-7842-4109-a499-f4c0fa5f831d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:26.754805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f330dd26-7842-4109-a499-f4c0fa5f831d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:26.755273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f330dd26-7842-4109-a499-f4c0fa5f831d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:26.756021 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f330dd26-7842-4109-a499-f4c0fa5f831d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:26.756449 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f330dd26-7842-4109-a499-f4c0fa5f831d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:26.780113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f330dd26-7842-4109-a499-f4c0fa5f831d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/ips" status: 200 len: 146 microversion: 2.1 time: 0.035458 Jul 20 22:49:26.780687 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 213/421] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:49:26 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:49:26.832314 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a8462955-2f36-4418-aedc-5d4210abfd41 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:26.832935 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a8462955-2f36-4418-aedc-5d4210abfd41 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:26.839312 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8462955-2f36-4418-aedc-5d4210abfd41 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:26.839758 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8462955-2f36-4418-aedc-5d4210abfd41 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:26.840512 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8462955-2f36-4418-aedc-5d4210abfd41 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:26.840945 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8462955-2f36-4418-aedc-5d4210abfd41 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:26.967866 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a8462955-2f36-4418-aedc-5d4210abfd41 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:26.975818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a8462955-2f36-4418-aedc-5d4210abfd41 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.147724 Jul 20 22:49:26.976379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 209/422] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:26 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:27.993281 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fb552b9a-0ee6-4c0d-b0ed-8fd9b6691ed1 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:27.993883 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fb552b9a-0ee6-4c0d-b0ed-8fd9b6691ed1 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:27.999845 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fb552b9a-0ee6-4c0d-b0ed-8fd9b6691ed1 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:28.000285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fb552b9a-0ee6-4c0d-b0ed-8fd9b6691ed1 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:28.001031 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fb552b9a-0ee6-4c0d-b0ed-8fd9b6691ed1 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:28.001463 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fb552b9a-0ee6-4c0d-b0ed-8fd9b6691ed1 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:28.131267 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fb552b9a-0ee6-4c0d-b0ed-8fd9b6691ed1 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:28.138790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fb552b9a-0ee6-4c0d-b0ed-8fd9b6691ed1 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.149345 Jul 20 22:49:28.139378 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 214/423] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:27 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:29.155931 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b8721440-d445-45ad-bbf9-332abd187e69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:29.156531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b8721440-d445-45ad-bbf9-332abd187e69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:29.163572 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b8721440-d445-45ad-bbf9-332abd187e69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:29.164010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b8721440-d445-45ad-bbf9-332abd187e69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:29.164750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b8721440-d445-45ad-bbf9-332abd187e69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:29.165173 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b8721440-d445-45ad-bbf9-332abd187e69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:29.309561 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b8721440-d445-45ad-bbf9-332abd187e69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:29.317645 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b8721440-d445-45ad-bbf9-332abd187e69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.165560 Jul 20 22:49:29.318194 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 210/424] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:29 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:30.340904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4d9ce6c7-4fb5-4064-a986-20c2d6290c69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:30.341510 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4d9ce6c7-4fb5-4064-a986-20c2d6290c69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:30.353461 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4d9ce6c7-4fb5-4064-a986-20c2d6290c69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:30.353910 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4d9ce6c7-4fb5-4064-a986-20c2d6290c69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:30.355060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4d9ce6c7-4fb5-4064-a986-20c2d6290c69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:30.355504 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4d9ce6c7-4fb5-4064-a986-20c2d6290c69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:30.493081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4d9ce6c7-4fb5-4064-a986-20c2d6290c69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:30.500526 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4d9ce6c7-4fb5-4064-a986-20c2d6290c69 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1318 microversion: 2.1 time: 0.163698 Jul 20 22:49:30.501083 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 215/425] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:30 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:31.517484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5b28cf6d-e003-49dd-b513-59a89c13bfda tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:31.518087 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5b28cf6d-e003-49dd-b513-59a89c13bfda tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:31.524374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b28cf6d-e003-49dd-b513-59a89c13bfda tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:31.524757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b28cf6d-e003-49dd-b513-59a89c13bfda tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:31.525778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b28cf6d-e003-49dd-b513-59a89c13bfda tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:31.526212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b28cf6d-e003-49dd-b513-59a89c13bfda tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:31.659474 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5b28cf6d-e003-49dd-b513-59a89c13bfda tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:31.666887 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5b28cf6d-e003-49dd-b513-59a89c13bfda tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1506 microversion: 2.1 time: 0.153157 Jul 20 22:49:31.678254 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 211/426] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:31 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:32.489840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d5d87500-ecc6-4949-b2da-bf1276202c25 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41ab6f4c-bded-4fee-ae6e-430988f82473"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:49:32.490895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d5d87500-ecc6-4949-b2da-bf1276202c25 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:32.497007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5d87500-ecc6-4949-b2da-bf1276202c25 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:32.497305 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5d87500-ecc6-4949-b2da-bf1276202c25 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:32.498060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5d87500-ecc6-4949-b2da-bf1276202c25 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:32.498488 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d5d87500-ecc6-4949-b2da-bf1276202c25 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:33.295749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d5d87500-ecc6-4949-b2da-bf1276202c25 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.809546 Jul 20 22:49:33.296753 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 216/427] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:49:32 2022] POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:49:41.857573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0d431311-97b5-4a9f-9e5a-189971137f58 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:49:41.859786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:41.860424 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=58 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:41.865684 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0d431311-97b5-4a9f-9e5a-189971137f58 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:41.866130 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0d431311-97b5-4a9f-9e5a-189971137f58 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:41.926022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0d431311-97b5-4a9f-9e5a-189971137f58 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Going to try to stop instance {{(pid=124913) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 22:49:42.048119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0d431311-97b5-4a9f-9e5a-189971137f58 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/action" status: 202 len: 0 microversion: 2.1 time: 0.194200 Jul 20 22:49:42.048814 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 212/428] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:49:41 2022] POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:49:42.059374 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-14b5ab7a-6442-4178-ad5b-d39c281689ab tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:42.060061 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-14b5ab7a-6442-4178-ad5b-d39c281689ab tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:42.067656 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-14b5ab7a-6442-4178-ad5b-d39c281689ab tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:42.068091 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-14b5ab7a-6442-4178-ad5b-d39c281689ab tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:42.068887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-14b5ab7a-6442-4178-ad5b-d39c281689ab tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:42.069319 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-14b5ab7a-6442-4178-ad5b-d39c281689ab tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:42.211111 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-14b5ab7a-6442-4178-ad5b-d39c281689ab tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:42.219181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-14b5ab7a-6442-4178-ad5b-d39c281689ab tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.164675 Jul 20 22:49:42.220323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 217/429] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:42 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:43.238652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-63e07ef2-2bf0-4f39-a36b-1859a35f6555 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:43.239273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-63e07ef2-2bf0-4f39-a36b-1859a35f6555 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:43.245378 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-63e07ef2-2bf0-4f39-a36b-1859a35f6555 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:43.245828 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-63e07ef2-2bf0-4f39-a36b-1859a35f6555 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:43.246583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-63e07ef2-2bf0-4f39-a36b-1859a35f6555 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:43.247037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-63e07ef2-2bf0-4f39-a36b-1859a35f6555 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:43.385284 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-63e07ef2-2bf0-4f39-a36b-1859a35f6555 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:43.394039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-63e07ef2-2bf0-4f39-a36b-1859a35f6555 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.159668 Jul 20 22:49:43.394612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 213/430] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:43 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:44.414310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-92837add-1df9-43d4-81a8-b46d734f7469 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:44.414939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-92837add-1df9-43d4-81a8-b46d734f7469 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:44.417680 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=30 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:44.422559 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-92837add-1df9-43d4-81a8-b46d734f7469 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:44.423083 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-92837add-1df9-43d4-81a8-b46d734f7469 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:44.429010 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-92837add-1df9-43d4-81a8-b46d734f7469 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:44.429010 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-92837add-1df9-43d4-81a8-b46d734f7469 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:44.429010 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:44.569649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-92837add-1df9-43d4-81a8-b46d734f7469 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:44.577787 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-92837add-1df9-43d4-81a8-b46d734f7469 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.169915 Jul 20 22:49:44.578343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 218/431] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:44 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:45.595247 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-51bebf46-93f9-4911-8a7b-3cc07c5060d7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:45.595858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-51bebf46-93f9-4911-8a7b-3cc07c5060d7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:45.602257 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51bebf46-93f9-4911-8a7b-3cc07c5060d7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:45.602701 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51bebf46-93f9-4911-8a7b-3cc07c5060d7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:45.603485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51bebf46-93f9-4911-8a7b-3cc07c5060d7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:45.603920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51bebf46-93f9-4911-8a7b-3cc07c5060d7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:45.734823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-51bebf46-93f9-4911-8a7b-3cc07c5060d7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:45.743834 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-51bebf46-93f9-4911-8a7b-3cc07c5060d7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.152414 Jul 20 22:49:45.744387 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 214/432] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:45 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:46.762001 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-acb0b48e-d2bb-4a7c-a883-7da218d7bf9d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:46.762640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-acb0b48e-d2bb-4a7c-a883-7da218d7bf9d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:46.770259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-acb0b48e-d2bb-4a7c-a883-7da218d7bf9d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:46.770699 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-acb0b48e-d2bb-4a7c-a883-7da218d7bf9d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:46.771503 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-acb0b48e-d2bb-4a7c-a883-7da218d7bf9d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:46.771928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-acb0b48e-d2bb-4a7c-a883-7da218d7bf9d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:46.912973 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-acb0b48e-d2bb-4a7c-a883-7da218d7bf9d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:46.921244 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-acb0b48e-d2bb-4a7c-a883-7da218d7bf9d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.163391 Jul 20 22:49:46.922222 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 219/433] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:46 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:47.917217 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-98e7fa75-86f3-4136-a046-45d0346dbda4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:47.917772 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-98e7fa75-86f3-4136-a046-45d0346dbda4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:47.924027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-98e7fa75-86f3-4136-a046-45d0346dbda4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:47.924466 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-98e7fa75-86f3-4136-a046-45d0346dbda4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:47.925213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-98e7fa75-86f3-4136-a046-45d0346dbda4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:47.925637 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-98e7fa75-86f3-4136-a046-45d0346dbda4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:47.939517 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a0487cf6-bb2c-48cf-8d09-770144225381 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:47.940325 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a0487cf6-bb2c-48cf-8d09-770144225381 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:47.948120 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a0487cf6-bb2c-48cf-8d09-770144225381 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:47.948688 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a0487cf6-bb2c-48cf-8d09-770144225381 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:47.949721 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a0487cf6-bb2c-48cf-8d09-770144225381 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:47.950964 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a0487cf6-bb2c-48cf-8d09-770144225381 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:47.957195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-98e7fa75-86f3-4136-a046-45d0346dbda4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/ips" status: 200 len: 148 microversion: 2.1 time: 0.043888 Jul 20 22:49:47.958191 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 215/434] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:49:47 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:49:48.123721 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a0487cf6-bb2c-48cf-8d09-770144225381 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:48.131857 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a0487cf6-bb2c-48cf-8d09-770144225381 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.196508 Jul 20 22:49:48.132446 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 220/435] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:47 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:49.149852 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d8bf7677-9948-4037-9c5e-cbe4af5ce7d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:49.150464 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d8bf7677-9948-4037-9c5e-cbe4af5ce7d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:49.156878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8bf7677-9948-4037-9c5e-cbe4af5ce7d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:49.157321 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8bf7677-9948-4037-9c5e-cbe4af5ce7d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:49.158074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8bf7677-9948-4037-9c5e-cbe4af5ce7d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:49.158504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8bf7677-9948-4037-9c5e-cbe4af5ce7d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:49.287757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d8bf7677-9948-4037-9c5e-cbe4af5ce7d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:49.295603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d8bf7677-9948-4037-9c5e-cbe4af5ce7d4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.149856 Jul 20 22:49:49.299178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 216/436] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:49 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:50.313444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-203d883a-6f69-4af6-bdf4-aed9b4ddd698 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:50.314053 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-203d883a-6f69-4af6-bdf4-aed9b4ddd698 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:50.321159 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-203d883a-6f69-4af6-bdf4-aed9b4ddd698 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:50.321603 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-203d883a-6f69-4af6-bdf4-aed9b4ddd698 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:50.322373 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-203d883a-6f69-4af6-bdf4-aed9b4ddd698 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:50.322809 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-203d883a-6f69-4af6-bdf4-aed9b4ddd698 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:50.453332 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-203d883a-6f69-4af6-bdf4-aed9b4ddd698 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:50.464205 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-203d883a-6f69-4af6-bdf4-aed9b4ddd698 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.154545 Jul 20 22:49:50.464843 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 221/437] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:50 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:50.731435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-28ca6759-ae1b-4115-a02d-2d1348920940 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91cf5fd9-685b-4303-bf10-5a2172a23743"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:49:50.732573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-28ca6759-ae1b-4115-a02d-2d1348920940 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:50.738935 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-28ca6759-ae1b-4115-a02d-2d1348920940 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:50.739401 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-28ca6759-ae1b-4115-a02d-2d1348920940 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:50.740147 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-28ca6759-ae1b-4115-a02d-2d1348920940 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:50.740575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-28ca6759-ae1b-4115-a02d-2d1348920940 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:51.447729 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-28ca6759-ae1b-4115-a02d-2d1348920940 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720535 Jul 20 22:49:51.448698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 217/438] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:49:50 2022] POST /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:49:51.480853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0fb3be1d-846e-440f-b324-690d87045e10 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:51.481464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0fb3be1d-846e-440f-b324-690d87045e10 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:51.488533 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0fb3be1d-846e-440f-b324-690d87045e10 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:51.488978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0fb3be1d-846e-440f-b324-690d87045e10 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:51.489744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0fb3be1d-846e-440f-b324-690d87045e10 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:51.490177 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0fb3be1d-846e-440f-b324-690d87045e10 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:51.620281 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0fb3be1d-846e-440f-b324-690d87045e10 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:51.629640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0fb3be1d-846e-440f-b324-690d87045e10 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.152474 Jul 20 22:49:51.630455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 222/439] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:51 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:52.648450 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-08030871-ffe0-4d69-b833-1557652144c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:52.649152 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-08030871-ffe0-4d69-b833-1557652144c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:52.656413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-08030871-ffe0-4d69-b833-1557652144c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:52.656859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-08030871-ffe0-4d69-b833-1557652144c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:52.657622 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-08030871-ffe0-4d69-b833-1557652144c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:52.658051 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-08030871-ffe0-4d69-b833-1557652144c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:52.797287 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-08030871-ffe0-4d69-b833-1557652144c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:52.805303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-08030871-ffe0-4d69-b833-1557652144c4 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.162343 Jul 20 22:49:52.805874 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 218/440] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:52 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:53.822966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8e257cbe-93c7-4416-b3e2-2b24b017330b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:53.823584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8e257cbe-93c7-4416-b3e2-2b24b017330b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:53.830159 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e257cbe-93c7-4416-b3e2-2b24b017330b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:53.831137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e257cbe-93c7-4416-b3e2-2b24b017330b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:53.831892 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e257cbe-93c7-4416-b3e2-2b24b017330b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:53.832328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e257cbe-93c7-4416-b3e2-2b24b017330b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:53.961701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8e257cbe-93c7-4416-b3e2-2b24b017330b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:53.969611 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8e257cbe-93c7-4416-b3e2-2b24b017330b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.150570 Jul 20 22:49:53.975805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 223/441] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:53 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:54.991146 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4579de5a-5f41-4cb9-8c7b-1ad2292124be tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:54.991754 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4579de5a-5f41-4cb9-8c7b-1ad2292124be tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:54.998185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4579de5a-5f41-4cb9-8c7b-1ad2292124be tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:54.998635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4579de5a-5f41-4cb9-8c7b-1ad2292124be tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:54.999424 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4579de5a-5f41-4cb9-8c7b-1ad2292124be tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:54.999861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4579de5a-5f41-4cb9-8c7b-1ad2292124be tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:55.137385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4579de5a-5f41-4cb9-8c7b-1ad2292124be tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:55.145380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4579de5a-5f41-4cb9-8c7b-1ad2292124be tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.158159 Jul 20 22:49:55.145950 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 219/442] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:54 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:56.163459 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e08c8cef-4f01-4fd0-a6be-2199d10232bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:56.164065 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e08c8cef-4f01-4fd0-a6be-2199d10232bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:56.170549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e08c8cef-4f01-4fd0-a6be-2199d10232bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:56.170989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e08c8cef-4f01-4fd0-a6be-2199d10232bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:56.171771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e08c8cef-4f01-4fd0-a6be-2199d10232bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:56.172201 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e08c8cef-4f01-4fd0-a6be-2199d10232bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:56.308452 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e08c8cef-4f01-4fd0-a6be-2199d10232bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:56.308452 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e08c8cef-4f01-4fd0-a6be-2199d10232bf tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.148787 Jul 20 22:49:56.308959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 224/443] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:56 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:57.326005 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7fa0b314-1f5d-40f0-98f2-e91211505963 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:57.326601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7fa0b314-1f5d-40f0-98f2-e91211505963 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:57.333068 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7fa0b314-1f5d-40f0-98f2-e91211505963 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:57.333505 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7fa0b314-1f5d-40f0-98f2-e91211505963 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:57.334253 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7fa0b314-1f5d-40f0-98f2-e91211505963 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:57.334675 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7fa0b314-1f5d-40f0-98f2-e91211505963 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:57.460447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7fa0b314-1f5d-40f0-98f2-e91211505963 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:57.468355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7fa0b314-1f5d-40f0-98f2-e91211505963 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1723 microversion: 2.1 time: 0.146163 Jul 20 22:49:57.468909 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 220/444] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:57 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:57.952938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7308a4b2-ec8f-4822-91cf-b972d89b0181 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "272fdb31-6520-4c85-b7b9-4cb93de7e3e6", "device": "/dev/sdb"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:49:57.955893 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7308a4b2-ec8f-4822-91cf-b972d89b0181 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:57.961718 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7308a4b2-ec8f-4822-91cf-b972d89b0181 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:57.962159 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7308a4b2-ec8f-4822-91cf-b972d89b0181 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:57.962916 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7308a4b2-ec8f-4822-91cf-b972d89b0181 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:57.963370 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7308a4b2-ec8f-4822-91cf-b972d89b0181 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:58.485653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-34ff45d8-ee07-49da-9ac9-089c095d7253 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:58.486447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-34ff45d8-ee07-49da-9ac9-089c095d7253 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:58.493152 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-34ff45d8-ee07-49da-9ac9-089c095d7253 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:58.493599 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-34ff45d8-ee07-49da-9ac9-089c095d7253 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:58.494397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-34ff45d8-ee07-49da-9ac9-089c095d7253 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:58.495188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-34ff45d8-ee07-49da-9ac9-089c095d7253 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:58.639236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-34ff45d8-ee07-49da-9ac9-089c095d7253 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:58.647882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-34ff45d8-ee07-49da-9ac9-089c095d7253 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1700 microversion: 2.1 time: 0.166102 Jul 20 22:49:58.648446 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 221/445] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:58 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1700 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:49:58.668131 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b1a0f1a1-5601-4422-8930-0eb4ce269d59 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:49:58.674306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1a0f1a1-5601-4422-8930-0eb4ce269d59 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:58.674764 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1a0f1a1-5601-4422-8930-0eb4ce269d59 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:58.696713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b1a0f1a1-5601-4422-8930-0eb4ce269d59 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Going to try to start instance {{(pid=124913) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 22:49:58.904421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b1a0f1a1-5601-4422-8930-0eb4ce269d59 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/action" status: 202 len: 0 microversion: 2.1 time: 0.239925 Jul 20 22:49:58.905066 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 222/446] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:49:58 2022] POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 22:49:58.913325 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-831ac517-3a9f-4f0b-9bc0-946e0bb7a53c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:49:58.914018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-831ac517-3a9f-4f0b-9bc0-946e0bb7a53c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:49:58.920258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-831ac517-3a9f-4f0b-9bc0-946e0bb7a53c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:58.920708 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-831ac517-3a9f-4f0b-9bc0-946e0bb7a53c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:58.921471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-831ac517-3a9f-4f0b-9bc0-946e0bb7a53c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:49:58.921900 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-831ac517-3a9f-4f0b-9bc0-946e0bb7a53c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:49:59.060933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-831ac517-3a9f-4f0b-9bc0-946e0bb7a53c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:49:59.071723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-831ac517-3a9f-4f0b-9bc0-946e0bb7a53c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1709 microversion: 2.1 time: 0.162391 Jul 20 22:49:59.072299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 223/447] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:49:58 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:49:59.133648 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7308a4b2-ec8f-4822-91cf-b972d89b0181 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "POST /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.184397 Jul 20 22:49:59.139070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 225/448] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:49:57 2022] POST /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe/os-volume_attachments => generated 194 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:50:00.000074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1a4e8ebb-6fcc-4179-911b-468a6051efc1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: .version_select at 0x7fe243fee430>, body: {"keypair": {"name": "tempest-keypair-1044150379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1Ke2YBqY4oUuggnOIXA8S0uy5MyWyWY4PuCkxH5KUOJn0JMvByO9C4ShQj6ifLvMX+6bEFHg4fjBg5VN3qW6V2miRjAWWRD0S/lnX+++doKYOIkc62WD5q63/ssTZOTA=="}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:00.014020 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-1a4e8ebb-6fcc-4179-911b-468a6051efc1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for project f733781536584f80acfc325bf8444536. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:50:00.018290 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-1a4e8ebb-6fcc-4179-911b-468a6051efc1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for user 3e072e59bf3e46aaa062ec85b0e2c91a and project f733781536584f80acfc325bf8444536. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:50:00.099213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8a76842b-5ae0-4d8c-88ff-33cc0eb537f6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:00.099901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8a76842b-5ae0-4d8c-88ff-33cc0eb537f6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:00.106150 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8a76842b-5ae0-4d8c-88ff-33cc0eb537f6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:00.106599 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8a76842b-5ae0-4d8c-88ff-33cc0eb537f6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:00.107387 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8a76842b-5ae0-4d8c-88ff-33cc0eb537f6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:00.107827 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8a76842b-5ae0-4d8c-88ff-33cc0eb537f6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:00.205956 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1a4e8ebb-6fcc-4179-911b-468a6051efc1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.208898 Jul 20 22:50:00.206851 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 224/449] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 22:49:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:50:00.244756 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8a76842b-5ae0-4d8c-88ff-33cc0eb537f6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:00.254040 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8a76842b-5ae0-4d8c-88ff-33cc0eb537f6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1709 microversion: 2.1 time: 0.160195 Jul 20 22:50:00.254607 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 226/450] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:00 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:50:01.271441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-734eecbe-8bd7-4d05-ac8d-e8e3773710db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:01.272050 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-734eecbe-8bd7-4d05-ac8d-e8e3773710db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:01.279070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-734eecbe-8bd7-4d05-ac8d-e8e3773710db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:01.279526 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-734eecbe-8bd7-4d05-ac8d-e8e3773710db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:01.280355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-734eecbe-8bd7-4d05-ac8d-e8e3773710db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:01.280791 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-734eecbe-8bd7-4d05-ac8d-e8e3773710db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:01.521999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-734eecbe-8bd7-4d05-ac8d-e8e3773710db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:01.530230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-734eecbe-8bd7-4d05-ac8d-e8e3773710db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1709 microversion: 2.1 time: 0.263369 Jul 20 22:50:01.531101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 225/451] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:01 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1709 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:02.507597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1655302430", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b157aec-dd9e-48b2-9003-4eeafc1a43e4"}], "security_groups": [{"name": "tempest-securitygroup--1677976755"}], "key_name": "tempest-keypair-1044150379", "user_data": "}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:02.549015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2f4f901d-934e-47a5-8d3a-13bd9b467e2a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:02.549392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2f4f901d-934e-47a5-8d3a-13bd9b467e2a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:02.556327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f4f901d-934e-47a5-8d3a-13bd9b467e2a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:02.556776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f4f901d-934e-47a5-8d3a-13bd9b467e2a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:02.557546 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f4f901d-934e-47a5-8d3a-13bd9b467e2a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:02.557983 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f4f901d-934e-47a5-8d3a-13bd9b467e2a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:02.576620 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:02.608367 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] validate_networks() for [('6b157aec-dd9e-48b2-9003-4eeafc1a43e4', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:50:02.691629 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2f4f901d-934e-47a5-8d3a-13bd9b467e2a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:02.699527 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2f4f901d-934e-47a5-8d3a-13bd9b467e2a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1713 microversion: 2.1 time: 0.154843 Jul 20 22:50:02.700099 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 226/452] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:02 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:50:02.976854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:50:02.977275 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:50:02.977749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:50:02.978179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:50:02.978592 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:50:02.987998 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:02.988440 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:02.989230 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:02.989662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:03.006803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for project f733781536584f80acfc325bf8444536. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:50:03.010730 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for user 3e072e59bf3e46aaa062ec85b0e2c91a and project f733781536584f80acfc325bf8444536. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:50:03.021785 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:50:03.024298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:50:03.185774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ddcc474c-084e-492f-927a-0e4ad74e2893 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.682359 Jul 20 22:50:03.186347 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 227/453] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:50:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:50:03.197034 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6452b8d2-ff56-4287-98dd-43bd47cc8d68 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:03.197353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6452b8d2-ff56-4287-98dd-43bd47cc8d68 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:03.264084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6452b8d2-ff56-4287-98dd-43bd47cc8d68 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:03.271643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6452b8d2-ff56-4287-98dd-43bd47cc8d68 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1242 microversion: 2.1 time: 0.078666 Jul 20 22:50:03.272295 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 227/454] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:03 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:04.289957 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4b79cb3a-c1be-4cd6-a456-803a4134793f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:04.290563 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4b79cb3a-c1be-4cd6-a456-803a4134793f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:04.297403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4b79cb3a-c1be-4cd6-a456-803a4134793f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:04.297848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4b79cb3a-c1be-4cd6-a456-803a4134793f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:04.299179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4b79cb3a-c1be-4cd6-a456-803a4134793f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:04.299618 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4b79cb3a-c1be-4cd6-a456-803a4134793f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:04.360342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4b79cb3a-c1be-4cd6-a456-803a4134793f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:04.367870 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4b79cb3a-c1be-4cd6-a456-803a4134793f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1246 microversion: 2.1 time: 0.082341 Jul 20 22:50:04.368557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 228/455] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:04 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:05.384938 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6ec9e9f5-e690-4363-bc33-bc66556a3dd7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:05.385563 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6ec9e9f5-e690-4363-bc33-bc66556a3dd7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:05.392077 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ec9e9f5-e690-4363-bc33-bc66556a3dd7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:05.392639 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ec9e9f5-e690-4363-bc33-bc66556a3dd7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:05.393396 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ec9e9f5-e690-4363-bc33-bc66556a3dd7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:05.394414 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ec9e9f5-e690-4363-bc33-bc66556a3dd7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:05.456432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6ec9e9f5-e690-4363-bc33-bc66556a3dd7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:05.464420 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6ec9e9f5-e690-4363-bc33-bc66556a3dd7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1294 microversion: 2.1 time: 0.083401 Jul 20 22:50:05.464980 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 228/456] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:05 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:06.481805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e814ea6d-7b54-450b-8896-e0a44164097b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:06.482433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e814ea6d-7b54-450b-8896-e0a44164097b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:06.489632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e814ea6d-7b54-450b-8896-e0a44164097b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:06.490073 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e814ea6d-7b54-450b-8896-e0a44164097b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:06.490840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e814ea6d-7b54-450b-8896-e0a44164097b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:06.491290 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e814ea6d-7b54-450b-8896-e0a44164097b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:06.761803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e814ea6d-7b54-450b-8896-e0a44164097b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:06.761803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e814ea6d-7b54-450b-8896-e0a44164097b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.272352 Jul 20 22:50:06.761803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 229/457] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:06 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:07.670323 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-803879a3-2f9f-47a6-baac-69bcb04d6a2c req-1a401cb4-14f0-434c-811e-d6d06c91ac58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24366b66-5a54-44ea-95a2-da361e4a3ffe", "tag": "45626d8c-d54c-4e76-87bd-74a8f515a33c"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:07.679713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-803879a3-2f9f-47a6-baac-69bcb04d6a2c req-1a401cb4-14f0-434c-811e-d6d06c91ac58 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:07.680152 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-803879a3-2f9f-47a6-baac-69bcb04d6a2c req-1a401cb4-14f0-434c-811e-d6d06c91ac58 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:07.691634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-803879a3-2f9f-47a6-baac-69bcb04d6a2c req-1a401cb4-14f0-434c-811e-d6d06c91ac58 service nova] Creating event network-changed:45626d8c-d54c-4e76-87bd-74a8f515a33c for instance 24366b66-5a54-44ea-95a2-da361e4a3ffe on hv-cinder-79987 Jul 20 22:50:07.696529 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-803879a3-2f9f-47a6-baac-69bcb04d6a2c req-1a401cb4-14f0-434c-811e-d6d06c91ac58 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030452 Jul 20 22:50:07.697185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 229/458] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:50:07.768164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b75e5cac-5542-4254-b2e7-e31fb8665f71 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:07.768802 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b75e5cac-5542-4254-b2e7-e31fb8665f71 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:07.776452 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b75e5cac-5542-4254-b2e7-e31fb8665f71 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:07.776898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b75e5cac-5542-4254-b2e7-e31fb8665f71 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:07.777809 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b75e5cac-5542-4254-b2e7-e31fb8665f71 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:07.778153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b75e5cac-5542-4254-b2e7-e31fb8665f71 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:08.010471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b75e5cac-5542-4254-b2e7-e31fb8665f71 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:08.018087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b75e5cac-5542-4254-b2e7-e31fb8665f71 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.253860 Jul 20 22:50:08.018658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 230/459] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:07 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:09.036678 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4b548086-d24b-4b33-a39f-40811fbd0b67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:09.037405 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4b548086-d24b-4b33-a39f-40811fbd0b67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:09.043524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4b548086-d24b-4b33-a39f-40811fbd0b67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:09.043973 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4b548086-d24b-4b33-a39f-40811fbd0b67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:09.044730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4b548086-d24b-4b33-a39f-40811fbd0b67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:09.045159 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4b548086-d24b-4b33-a39f-40811fbd0b67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:09.177286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4b548086-d24b-4b33-a39f-40811fbd0b67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:09.184789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4b548086-d24b-4b33-a39f-40811fbd0b67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.152700 Jul 20 22:50:09.185566 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 230/460] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:09 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:10.201704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1a6d5d18-0a72-4afd-9b28-7ee071f2528a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:10.202359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1a6d5d18-0a72-4afd-9b28-7ee071f2528a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:10.209559 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1a6d5d18-0a72-4afd-9b28-7ee071f2528a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:10.210003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1a6d5d18-0a72-4afd-9b28-7ee071f2528a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:10.210760 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1a6d5d18-0a72-4afd-9b28-7ee071f2528a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:10.211239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1a6d5d18-0a72-4afd-9b28-7ee071f2528a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:10.354772 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1a6d5d18-0a72-4afd-9b28-7ee071f2528a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:10.362226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1a6d5d18-0a72-4afd-9b28-7ee071f2528a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.164380 Jul 20 22:50:10.362779 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 231/461] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:10 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:11.380160 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-660fa36d-30c6-4648-8f39-159348032a02 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:11.380993 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-660fa36d-30c6-4648-8f39-159348032a02 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:11.387983 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-660fa36d-30c6-4648-8f39-159348032a02 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:11.388424 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-660fa36d-30c6-4648-8f39-159348032a02 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:11.389461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-660fa36d-30c6-4648-8f39-159348032a02 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:11.389951 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-660fa36d-30c6-4648-8f39-159348032a02 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:11.519980 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-660fa36d-30c6-4648-8f39-159348032a02 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:11.527577 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-660fa36d-30c6-4648-8f39-159348032a02 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.152138 Jul 20 22:50:11.528126 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 231/462] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:11 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:12.544431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3cb9ec34-86fb-4ce6-816b-f5622e0c6448 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:12.544951 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3cb9ec34-86fb-4ce6-816b-f5622e0c6448 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:12.551466 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3cb9ec34-86fb-4ce6-816b-f5622e0c6448 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:12.551908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3cb9ec34-86fb-4ce6-816b-f5622e0c6448 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:12.552659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3cb9ec34-86fb-4ce6-816b-f5622e0c6448 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:12.553089 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3cb9ec34-86fb-4ce6-816b-f5622e0c6448 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:12.678500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3cb9ec34-86fb-4ce6-816b-f5622e0c6448 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:12.685816 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3cb9ec34-86fb-4ce6-816b-f5622e0c6448 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.145272 Jul 20 22:50:12.686396 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 232/463] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:12 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:13.701592 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-efaa7e0c-374c-4635-a3b7-3eeca96facf3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:13.702198 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-efaa7e0c-374c-4635-a3b7-3eeca96facf3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:13.704738 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=6 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:13.705403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:13.710176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-efaa7e0c-374c-4635-a3b7-3eeca96facf3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:13.712941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-efaa7e0c-374c-4635-a3b7-3eeca96facf3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:13.712941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-efaa7e0c-374c-4635-a3b7-3eeca96facf3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:13.712941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-efaa7e0c-374c-4635-a3b7-3eeca96facf3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:13.840507 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-efaa7e0c-374c-4635-a3b7-3eeca96facf3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:13.848327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-efaa7e0c-374c-4635-a3b7-3eeca96facf3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.150533 Jul 20 22:50:13.849152 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 232/464] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:13 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:14.865467 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4bb3544c-5743-4104-8a80-849db6917ef4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:14.866068 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4bb3544c-5743-4104-8a80-849db6917ef4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:14.868065 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:14.868724 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=6 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:14.869855 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:14.874598 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4bb3544c-5743-4104-8a80-849db6917ef4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:14.876187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4bb3544c-5743-4104-8a80-849db6917ef4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:14.876187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4bb3544c-5743-4104-8a80-849db6917ef4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:14.876551 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4bb3544c-5743-4104-8a80-849db6917ef4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:14.880906 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:15.008687 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4bb3544c-5743-4104-8a80-849db6917ef4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:15.016921 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4bb3544c-5743-4104-8a80-849db6917ef4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.155725 Jul 20 22:50:15.019601 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 233/465] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:14 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:16.034083 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-26697dd7-cbe6-4559-8089-3d7aca2fa6f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:16.034665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-26697dd7-cbe6-4559-8089-3d7aca2fa6f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:16.041585 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-26697dd7-cbe6-4559-8089-3d7aca2fa6f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:16.042029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-26697dd7-cbe6-4559-8089-3d7aca2fa6f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:16.042776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-26697dd7-cbe6-4559-8089-3d7aca2fa6f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:16.043234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-26697dd7-cbe6-4559-8089-3d7aca2fa6f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:16.167088 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-26697dd7-cbe6-4559-8089-3d7aca2fa6f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:16.174291 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-26697dd7-cbe6-4559-8089-3d7aca2fa6f6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.144159 Jul 20 22:50:16.174842 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 233/466] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:16 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:17.191803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-91b38e6b-dfa6-4f91-b07e-a2728d113492 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:17.192355 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-91b38e6b-dfa6-4f91-b07e-a2728d113492 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:17.200035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91b38e6b-dfa6-4f91-b07e-a2728d113492 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:17.200486 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91b38e6b-dfa6-4f91-b07e-a2728d113492 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:17.201249 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91b38e6b-dfa6-4f91-b07e-a2728d113492 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:17.201682 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91b38e6b-dfa6-4f91-b07e-a2728d113492 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:17.330569 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-91b38e6b-dfa6-4f91-b07e-a2728d113492 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:17.338161 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-91b38e6b-dfa6-4f91-b07e-a2728d113492 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.150835 Jul 20 22:50:17.338700 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 234/467] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:17 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:18.355347 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4479816f-5937-4034-a814-ba31dab3aadc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:18.355948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4479816f-5937-4034-a814-ba31dab3aadc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:18.362402 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4479816f-5937-4034-a814-ba31dab3aadc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:18.362875 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4479816f-5937-4034-a814-ba31dab3aadc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:18.363649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4479816f-5937-4034-a814-ba31dab3aadc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:18.364081 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4479816f-5937-4034-a814-ba31dab3aadc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:18.497690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4479816f-5937-4034-a814-ba31dab3aadc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:18.504986 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4479816f-5937-4034-a814-ba31dab3aadc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.153431 Jul 20 22:50:18.505544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 234/468] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:18 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:19.521994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a54bc0e1-ac83-4ea2-bd36-348a4b3b9083 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:19.522617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a54bc0e1-ac83-4ea2-bd36-348a4b3b9083 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:19.530051 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a54bc0e1-ac83-4ea2-bd36-348a4b3b9083 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:19.530489 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a54bc0e1-ac83-4ea2-bd36-348a4b3b9083 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:19.531267 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a54bc0e1-ac83-4ea2-bd36-348a4b3b9083 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:19.531697 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a54bc0e1-ac83-4ea2-bd36-348a4b3b9083 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:19.661209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a54bc0e1-ac83-4ea2-bd36-348a4b3b9083 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:19.668571 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a54bc0e1-ac83-4ea2-bd36-348a4b3b9083 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.150383 Jul 20 22:50:19.669135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 235/469] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:19 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:20.685380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-778d0748-9e05-46e0-80a7-2ca730bc5ddd tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:20.686059 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-778d0748-9e05-46e0-80a7-2ca730bc5ddd tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:20.692523 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-778d0748-9e05-46e0-80a7-2ca730bc5ddd tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:20.692971 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-778d0748-9e05-46e0-80a7-2ca730bc5ddd tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:20.693740 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-778d0748-9e05-46e0-80a7-2ca730bc5ddd tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:20.694176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-778d0748-9e05-46e0-80a7-2ca730bc5ddd tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:20.823432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-778d0748-9e05-46e0-80a7-2ca730bc5ddd tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:20.830966 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-778d0748-9e05-46e0-80a7-2ca730bc5ddd tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.149414 Jul 20 22:50:20.831545 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 235/470] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:20 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:21.847633 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5f12616e-e0c6-40d3-8fe2-ea062a1d38bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:21.848249 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-5f12616e-e0c6-40d3-8fe2-ea062a1d38bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:21.854728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5f12616e-e0c6-40d3-8fe2-ea062a1d38bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:21.855163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5f12616e-e0c6-40d3-8fe2-ea062a1d38bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:21.855939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5f12616e-e0c6-40d3-8fe2-ea062a1d38bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:21.856366 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5f12616e-e0c6-40d3-8fe2-ea062a1d38bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:21.986468 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-5f12616e-e0c6-40d3-8fe2-ea062a1d38bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:21.993832 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5f12616e-e0c6-40d3-8fe2-ea062a1d38bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.149969 Jul 20 22:50:21.999804 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 236/471] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:21 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:23.012361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0c3289f9-d6b7-44d0-87cd-b1428657d080 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:23.012971 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0c3289f9-d6b7-44d0-87cd-b1428657d080 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:23.019473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0c3289f9-d6b7-44d0-87cd-b1428657d080 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:23.019910 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0c3289f9-d6b7-44d0-87cd-b1428657d080 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:23.020668 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0c3289f9-d6b7-44d0-87cd-b1428657d080 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:23.021094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0c3289f9-d6b7-44d0-87cd-b1428657d080 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:23.153370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0c3289f9-d6b7-44d0-87cd-b1428657d080 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:23.160814 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0c3289f9-d6b7-44d0-87cd-b1428657d080 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.153713 Jul 20 22:50:23.161394 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 236/472] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:23 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:50:23.234957 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-c3ad5f77-3a94-4425-8a81-043f6f1cccf9 req-0417fd27-fd24-477c-9db0-546a63124223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24366b66-5a54-44ea-95a2-da361e4a3ffe", "name": "network-vif-plugged", "status": "completed", "tag": "45626d8c-d54c-4e76-87bd-74a8f515a33c"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:23.243721 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c3ad5f77-3a94-4425-8a81-043f6f1cccf9 req-0417fd27-fd24-477c-9db0-546a63124223 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:23.244158 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c3ad5f77-3a94-4425-8a81-043f6f1cccf9 req-0417fd27-fd24-477c-9db0-546a63124223 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:23.254716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-c3ad5f77-3a94-4425-8a81-043f6f1cccf9 req-0417fd27-fd24-477c-9db0-546a63124223 service nova] Creating event network-vif-plugged:45626d8c-d54c-4e76-87bd-74a8f515a33c for instance 24366b66-5a54-44ea-95a2-da361e4a3ffe on hv-cinder-79987 Jul 20 22:50:23.260166 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-c3ad5f77-3a94-4425-8a81-043f6f1cccf9 req-0417fd27-fd24-477c-9db0-546a63124223 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028850 Jul 20 22:50:23.260737 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 237/473] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:50:24.178172 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0acfd89e-b607-4c85-91f2-6cc8307683fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:24.178713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0acfd89e-b607-4c85-91f2-6cc8307683fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:24.185971 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0acfd89e-b607-4c85-91f2-6cc8307683fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:24.186416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0acfd89e-b607-4c85-91f2-6cc8307683fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:24.187204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0acfd89e-b607-4c85-91f2-6cc8307683fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:24.187640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0acfd89e-b607-4c85-91f2-6cc8307683fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:24.471287 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0acfd89e-b607-4c85-91f2-6cc8307683fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:24.478691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0acfd89e-b607-4c85-91f2-6cc8307683fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.304428 Jul 20 22:50:24.479294 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 237/474] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:24 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:25.496533 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1b7962cf-e9cf-4349-b03f-bf403bae769a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:25.497137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1b7962cf-e9cf-4349-b03f-bf403bae769a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:25.503558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1b7962cf-e9cf-4349-b03f-bf403bae769a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:25.503882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1b7962cf-e9cf-4349-b03f-bf403bae769a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:25.504554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1b7962cf-e9cf-4349-b03f-bf403bae769a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:25.504985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1b7962cf-e9cf-4349-b03f-bf403bae769a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:25.691172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1b7962cf-e9cf-4349-b03f-bf403bae769a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:25.699849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1b7962cf-e9cf-4349-b03f-bf403bae769a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.208030 Jul 20 22:50:25.700429 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 238/475] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:25 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:26.716246 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ce379bed-8e50-45c9-b8c8-93a5e34716bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:26.716871 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ce379bed-8e50-45c9-b8c8-93a5e34716bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:26.723416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce379bed-8e50-45c9-b8c8-93a5e34716bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:26.723865 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce379bed-8e50-45c9-b8c8-93a5e34716bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:26.724621 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce379bed-8e50-45c9-b8c8-93a5e34716bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:26.725062 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce379bed-8e50-45c9-b8c8-93a5e34716bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:26.854995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ce379bed-8e50-45c9-b8c8-93a5e34716bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:26.862328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ce379bed-8e50-45c9-b8c8-93a5e34716bc tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.149951 Jul 20 22:50:26.862962 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 238/476] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:26 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:27.879825 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9c064378-aeb9-4eb6-8fdb-be095e614dab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:27.880437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9c064378-aeb9-4eb6-8fdb-be095e614dab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:27.887390 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c064378-aeb9-4eb6-8fdb-be095e614dab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:27.887839 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c064378-aeb9-4eb6-8fdb-be095e614dab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:27.888591 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c064378-aeb9-4eb6-8fdb-be095e614dab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:27.889024 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c064378-aeb9-4eb6-8fdb-be095e614dab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:28.014573 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9c064378-aeb9-4eb6-8fdb-be095e614dab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:28.022037 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9c064378-aeb9-4eb6-8fdb-be095e614dab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.146055 Jul 20 22:50:28.022632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 239/477] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:27 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:29.040043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-75dab1a0-d899-4a89-851e-226a27f83053 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:29.040568 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-75dab1a0-d899-4a89-851e-226a27f83053 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:29.046938 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-75dab1a0-d899-4a89-851e-226a27f83053 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:29.047420 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-75dab1a0-d899-4a89-851e-226a27f83053 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:29.048181 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-75dab1a0-d899-4a89-851e-226a27f83053 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:29.048617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-75dab1a0-d899-4a89-851e-226a27f83053 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:29.177963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-75dab1a0-d899-4a89-851e-226a27f83053 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:29.185599 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-75dab1a0-d899-4a89-851e-226a27f83053 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.150027 Jul 20 22:50:29.186181 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 239/478] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:29 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:30.202799 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f1f466cc-6dd9-44dc-a8e4-23b299226348 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:30.203500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f1f466cc-6dd9-44dc-a8e4-23b299226348 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:30.210049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f1f466cc-6dd9-44dc-a8e4-23b299226348 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:30.210487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f1f466cc-6dd9-44dc-a8e4-23b299226348 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:30.211306 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f1f466cc-6dd9-44dc-a8e4-23b299226348 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:30.211767 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f1f466cc-6dd9-44dc-a8e4-23b299226348 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:30.343559 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f1f466cc-6dd9-44dc-a8e4-23b299226348 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:30.350965 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f1f466cc-6dd9-44dc-a8e4-23b299226348 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1368 microversion: 2.1 time: 0.152014 Jul 20 22:50:30.351559 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 240/479] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:30 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:31.368073 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6d5f822f-7f29-4ea9-ba9b-f630d95b5772 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:31.368743 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6d5f822f-7f29-4ea9-ba9b-f630d95b5772 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:31.375026 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6d5f822f-7f29-4ea9-ba9b-f630d95b5772 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:31.375470 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6d5f822f-7f29-4ea9-ba9b-f630d95b5772 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:31.376221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6d5f822f-7f29-4ea9-ba9b-f630d95b5772 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:31.376672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6d5f822f-7f29-4ea9-ba9b-f630d95b5772 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:31.516336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6d5f822f-7f29-4ea9-ba9b-f630d95b5772 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:31.524864 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6d5f822f-7f29-4ea9-ba9b-f630d95b5772 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1558 microversion: 2.1 time: 0.160831 Jul 20 22:50:31.525445 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 240/480] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:31 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:31.541205 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3c340391-b4a4-4097-bd66-0eaa75adbb4a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:31.541746 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3c340391-b4a4-4097-bd66-0eaa75adbb4a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:31.548319 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c340391-b4a4-4097-bd66-0eaa75adbb4a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:31.548762 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c340391-b4a4-4097-bd66-0eaa75adbb4a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:31.549519 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c340391-b4a4-4097-bd66-0eaa75adbb4a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:31.549949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c340391-b4a4-4097-bd66-0eaa75adbb4a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:31.625245 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3c340391-b4a4-4097-bd66-0eaa75adbb4a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087981 Jul 20 22:50:31.625836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 241/481] 10.222.0.81 () {58 vars in 1274 bytes} [Wed Jul 20 22:50:31 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:50:32.141147 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4fe2636f-d5f1-4422-a17b-039aa48f6cf7 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:32.141637 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4fe2636f-d5f1-4422-a17b-039aa48f6cf7 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:32.147843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4fe2636f-d5f1-4422-a17b-039aa48f6cf7 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:32.148369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4fe2636f-d5f1-4422-a17b-039aa48f6cf7 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:32.149127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4fe2636f-d5f1-4422-a17b-039aa48f6cf7 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:32.149560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4fe2636f-d5f1-4422-a17b-039aa48f6cf7 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:32.277404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-4fe2636f-d5f1-4422-a17b-039aa48f6cf7 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lazy-loading 'services' on Instance uuid 3f3cf5eb-8305-465f-8390-e522c61b12fe {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:50:32.532999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4fe2636f-d5f1-4422-a17b-039aa48f6cf7 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe/os-volume_attachments/272fdb31-6520-4c85-b7b9-4cb93de7e3e6" status: 202 len: 0 microversion: 2.1 time: 0.395480 Jul 20 22:50:32.537193 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 241/482] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:50:32 2022] DELETE /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe/os-volume_attachments/272fdb31-6520-4c85-b7b9-4cb93de7e3e6 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:50:32.864992 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-da263458-80e7-4bf2-8eea-9b379eca01ed req-7bfd046e-c9c3-46ff-ab87-8431549a8792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24366b66-5a54-44ea-95a2-da361e4a3ffe", "tag": "45626d8c-d54c-4e76-87bd-74a8f515a33c"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:32.873569 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-da263458-80e7-4bf2-8eea-9b379eca01ed req-7bfd046e-c9c3-46ff-ab87-8431549a8792 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:32.874009 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-da263458-80e7-4bf2-8eea-9b379eca01ed req-7bfd046e-c9c3-46ff-ab87-8431549a8792 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:32.885822 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-da263458-80e7-4bf2-8eea-9b379eca01ed req-7bfd046e-c9c3-46ff-ab87-8431549a8792 service nova] Creating event network-changed:45626d8c-d54c-4e76-87bd-74a8f515a33c for instance 24366b66-5a54-44ea-95a2-da361e4a3ffe on hv-cinder-79987 Jul 20 22:50:32.891045 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-da263458-80e7-4bf2-8eea-9b379eca01ed req-7bfd046e-c9c3-46ff-ab87-8431549a8792 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030133 Jul 20 22:50:32.891899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 242/483] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:50:34.710506 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-71c16499-51d5-494d-adf1-831f205e5407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:34.711124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-71c16499-51d5-494d-adf1-831f205e5407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:34.717956 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-71c16499-51d5-494d-adf1-831f205e5407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:34.718408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-71c16499-51d5-494d-adf1-831f205e5407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:34.719198 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-71c16499-51d5-494d-adf1-831f205e5407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:34.719671 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-71c16499-51d5-494d-adf1-831f205e5407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:34.723651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:34.745042 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-71c16499-51d5-494d-adf1-831f205e5407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:50:35.081745 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-71c16499-51d5-494d-adf1-831f205e5407 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 204 len: 0 microversion: 2.1 time: 0.375737 Jul 20 22:50:35.082324 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 242/484] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:50:34 2022] DELETE /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:50:35.091599 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d147ca4a-08e3-4e5e-9a4d-8cb11bc0ad40 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:35.092285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d147ca4a-08e3-4e5e-9a4d-8cb11bc0ad40 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:35.099217 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d147ca4a-08e3-4e5e-9a4d-8cb11bc0ad40 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:35.099655 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d147ca4a-08e3-4e5e-9a4d-8cb11bc0ad40 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:35.100401 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d147ca4a-08e3-4e5e-9a4d-8cb11bc0ad40 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:35.100827 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d147ca4a-08e3-4e5e-9a4d-8cb11bc0ad40 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:35.230885 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d147ca4a-08e3-4e5e-9a4d-8cb11bc0ad40 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:35.238594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d147ca4a-08e3-4e5e-9a4d-8cb11bc0ad40 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1512 microversion: 2.1 time: 0.151125 Jul 20 22:50:35.239282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 243/485] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:35 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:50:36.256417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-97c0ef68-7122-45a5-8c6e-d935a5b76779 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:36.257115 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-97c0ef68-7122-45a5-8c6e-d935a5b76779 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:36.263569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97c0ef68-7122-45a5-8c6e-d935a5b76779 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:36.264015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97c0ef68-7122-45a5-8c6e-d935a5b76779 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:36.264772 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97c0ef68-7122-45a5-8c6e-d935a5b76779 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:36.265204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97c0ef68-7122-45a5-8c6e-d935a5b76779 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:36.397672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-97c0ef68-7122-45a5-8c6e-d935a5b76779 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:36.405652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-97c0ef68-7122-45a5-8c6e-d935a5b76779 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1512 microversion: 2.1 time: 0.153498 Jul 20 22:50:36.406217 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 243/486] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:36 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:37.423614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d4013851-cc7a-446a-b6cb-61a0b7d43e9f tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:37.424228 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d4013851-cc7a-446a-b6cb-61a0b7d43e9f tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:37.431367 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4013851-cc7a-446a-b6cb-61a0b7d43e9f tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:37.431815 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4013851-cc7a-446a-b6cb-61a0b7d43e9f tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:37.432576 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4013851-cc7a-446a-b6cb-61a0b7d43e9f tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:37.433009 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4013851-cc7a-446a-b6cb-61a0b7d43e9f tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:37.624979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d4013851-cc7a-446a-b6cb-61a0b7d43e9f tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:37.632635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d4013851-cc7a-446a-b6cb-61a0b7d43e9f tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1512 microversion: 2.1 time: 0.212753 Jul 20 22:50:37.633257 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 244/487] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:37 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:37.792758 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-5b62676e-bb95-4bf0-a76e-f45793caa77c req-b73b502d-764c-45ba-9ddf-b5ed379a9e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3cf5eb-8305-465f-8390-e522c61b12fe", "name": "network-vif-deleted", "tag": "36e980b0-9ef6-40fd-8b37-e7269800c0dc"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:37.801643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-5b62676e-bb95-4bf0-a76e-f45793caa77c req-b73b502d-764c-45ba-9ddf-b5ed379a9e16 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:37.805989 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-5b62676e-bb95-4bf0-a76e-f45793caa77c req-b73b502d-764c-45ba-9ddf-b5ed379a9e16 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:37.816493 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-5b62676e-bb95-4bf0-a76e-f45793caa77c req-b73b502d-764c-45ba-9ddf-b5ed379a9e16 service nova] Creating event network-vif-deleted:36e980b0-9ef6-40fd-8b37-e7269800c0dc for instance 3f3cf5eb-8305-465f-8390-e522c61b12fe on hv-cinder-79987 Jul 20 22:50:37.821449 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-5b62676e-bb95-4bf0-a76e-f45793caa77c req-b73b502d-764c-45ba-9ddf-b5ed379a9e16 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032973 Jul 20 22:50:37.822126 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 244/488] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:50:38.649906 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:38.650512 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:38.656848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:38.657287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:38.658077 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:38.658505 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:38.690577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:38.691003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:38.691482 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lazy-loading 'fault' on Instance uuid 3f3cf5eb-8305-465f-8390-e522c61b12fe {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:50:38.739311 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:38.747264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4509cc3d-b60a-4123-84c5-e974659bb9b4 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 200 len: 1308 microversion: 2.1 time: 0.101501 Jul 20 22:50:38.748019 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 245/489] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:38 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:39.764723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:39.765421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: 3f3cf5eb-8305-465f-8390-e522c61b12fe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:39.772072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:39.772777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:39.774149 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:39.774580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:39.787519 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] HTTP exception thrown: Instance 3f3cf5eb-8305-465f-8390-e522c61b12fe could not be found. Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Request method failure captured: Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe HTTP/1.1 Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IZiP0dyGHEYbgtpHoQp-7NK2NWQ-3Wx0x26hK7tPzomJGulhTK4ke3xDlDDs49KBrglRKjAjESFBkVX7U_v_XTnwaEGyP9T1GRq7HdPQle3c4yfNxI9Ri46MYHEFV_vGiZxlQ35vHFjwINzpvtdJreKt_B3woi8WECVpmkVqoAStbo Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 650d54a3145d42748ed81457cdd1eb34 Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1771043022 Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:50:39.789110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_650d54a3145d42748ed81457cdd1eb34", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/650d54a3145d42748ed81457cdd1eb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/650d54a3145d42748ed81457cdd1eb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/650d54a3145d42748ed81457cdd1eb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesSnapshotTestJSON-1771043022 Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 650d54a3145d42748ed81457cdd1eb34 Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1771043022 Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesSnapshotTestJSON-1771043022-project Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 1f237b9adae24d1ca2262d89eb000de4 Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesSnapshotTestJSON-1771043022-project Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 3f3cf5eb-8305-465f-8390-e522c61b12fe could not be found. Jul 20 22:50:39.790714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '3f3cf5eb-8305-465f-8390-e522c61b12fe'} Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3cf5eb-8305-465f-8390-e522c61b12fe could not be found. Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:50:39.791780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3cf5eb-8305-465f-8390-e522c61b12fe could not be found. Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3cf5eb-8305-465f-8390-e522c61b12fe could not be found. Jul 20 22:50:39.793240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:50:39.794530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Returning 404 to user: Instance 3f3cf5eb-8305-465f-8390-e522c61b12fe could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:50:39.794530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2f05c94d-a2ec-4e4a-9fac-ce38d64f7c00 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe" status: 404 len: 111 microversion: 2.1 time: 0.029946 Jul 20 22:50:39.794530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 245/490] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:39 2022] GET /compute/v2.1/servers/3f3cf5eb-8305-465f-8390-e522c61b12fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:50:47.738260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-508d307b-2ab9-4fac-a503-e01adad46dcb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37dc87b6-46ba-4422-8f33-14e3c2e74060"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:47.739429 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-508d307b-2ab9-4fac-a503-e01adad46dcb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:47.741410 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=28 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:47.746265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-508d307b-2ab9-4fac-a503-e01adad46dcb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:47.746701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-508d307b-2ab9-4fac-a503-e01adad46dcb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:47.747564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-508d307b-2ab9-4fac-a503-e01adad46dcb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:47.747985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-508d307b-2ab9-4fac-a503-e01adad46dcb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:47.750395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=70 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:51.130664 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-508d307b-2ab9-4fac-a503-e01adad46dcb tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.498306 Jul 20 22:50:51.131345 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 246/491] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:50:47 2022] POST /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments => generated 194 bytes in 3500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:50:52.560651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1173060093", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "networks": [{"uuid": "25cdff7d-27ed-4136-8183-3055182fbcc3"}]}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:52.567521 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:52.568180 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:52.618464 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] validate_networks() for [('25cdff7d-27ed-4136-8183-3055182fbcc3', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:50:53.013465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:50:53.013887 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:50:53.014362 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:50:53.014787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:50:53.015225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:50:53.024122 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:53.024596 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:53.025386 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:53.025820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:53.041891 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Getting quotas for project 650d54a3145d42748ed81457cdd1eb34. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:50:53.045805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Getting quotas for user 1f237b9adae24d1ca2262d89eb000de4 and project 650d54a3145d42748ed81457cdd1eb34. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:50:53.057131 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:50:53.066971 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:50:53.186320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4004d117-04ac-433d-b088-3f137eb77e83 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629680 Jul 20 22:50:53.186987 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 246/492] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:50:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:50:53.198994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0766bbf3-64c3-4303-89ec-8ea0d62a438a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:53.199704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0766bbf3-64c3-4303-89ec-8ea0d62a438a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:53.264660 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0766bbf3-64c3-4303-89ec-8ea0d62a438a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:53.272541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0766bbf3-64c3-4303-89ec-8ea0d62a438a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1219 microversion: 2.1 time: 0.079178 Jul 20 22:50:53.273109 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 247/493] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:53 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:54.290528 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-02d147d4-d666-42e1-aed1-bd9e6a095c76 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:54.291156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-02d147d4-d666-42e1-aed1-bd9e6a095c76 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:54.343756 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-02d147d4-d666-42e1-aed1-bd9e6a095c76 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:54.350889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-02d147d4-d666-42e1-aed1-bd9e6a095c76 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1219 microversion: 2.1 time: 0.064816 Jul 20 22:50:54.351484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 247/494] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:54 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:55.367645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-04a47384-1ceb-4142-816b-410e17ba5990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:55.368252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-04a47384-1ceb-4142-816b-410e17ba5990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:55.375582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04a47384-1ceb-4142-816b-410e17ba5990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:55.386563 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04a47384-1ceb-4142-816b-410e17ba5990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:55.386563 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04a47384-1ceb-4142-816b-410e17ba5990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:55.386563 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04a47384-1ceb-4142-816b-410e17ba5990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:55.440172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-04a47384-1ceb-4142-816b-410e17ba5990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:55.447642 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-04a47384-1ceb-4142-816b-410e17ba5990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1271 microversion: 2.1 time: 0.083741 Jul 20 22:50:55.448133 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 248/495] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:55 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:56.467333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ed9baca4-fa9a-4730-9ba4-6f1e5736e990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:56.467333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ed9baca4-fa9a-4730-9ba4-6f1e5736e990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:56.475676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed9baca4-fa9a-4730-9ba4-6f1e5736e990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:56.476124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed9baca4-fa9a-4730-9ba4-6f1e5736e990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:56.476894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed9baca4-fa9a-4730-9ba4-6f1e5736e990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:56.477319 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed9baca4-fa9a-4730-9ba4-6f1e5736e990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:56.607856 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ed9baca4-fa9a-4730-9ba4-6f1e5736e990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:56.615303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ed9baca4-fa9a-4730-9ba4-6f1e5736e990 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.154566 Jul 20 22:50:56.615871 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 248/496] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:56 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:57.462667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-5a8dae3d-3f2c-4c37-a748-e167390447f2 req-74612b27-50e8-4e35-acb1-b73d70bd1ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e03f98-910e-4eeb-a14d-e06495d39bc2", "tag": "0efce0f9-7d60-43a9-959f-b7ebca9cd95d"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:57.471183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5a8dae3d-3f2c-4c37-a748-e167390447f2 req-74612b27-50e8-4e35-acb1-b73d70bd1ffe service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:57.475327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5a8dae3d-3f2c-4c37-a748-e167390447f2 req-74612b27-50e8-4e35-acb1-b73d70bd1ffe service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:57.485676 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-5a8dae3d-3f2c-4c37-a748-e167390447f2 req-74612b27-50e8-4e35-acb1-b73d70bd1ffe service nova] Creating event network-changed:0efce0f9-7d60-43a9-959f-b7ebca9cd95d for instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 on hv-cinder-79987 Jul 20 22:50:57.490525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-5a8dae3d-3f2c-4c37-a748-e167390447f2 req-74612b27-50e8-4e35-acb1-b73d70bd1ffe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031532 Jul 20 22:50:57.491272 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 249/497] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:50:57.632333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-49e6f43e-baad-4192-aa3a-38b8f855f2de tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:57.632939 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-49e6f43e-baad-4192-aa3a-38b8f855f2de tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:57.640160 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49e6f43e-baad-4192-aa3a-38b8f855f2de tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:57.640606 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49e6f43e-baad-4192-aa3a-38b8f855f2de tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:57.641367 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49e6f43e-baad-4192-aa3a-38b8f855f2de tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:57.641802 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49e6f43e-baad-4192-aa3a-38b8f855f2de tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:57.768946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-49e6f43e-baad-4192-aa3a-38b8f855f2de tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:57.776879 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-49e6f43e-baad-4192-aa3a-38b8f855f2de tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.148327 Jul 20 22:50:57.784622 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 249/498] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:57 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:58.794888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-31c6c663-e3d0-4999-b561-5ff677f1d590 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:58.795546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-31c6c663-e3d0-4999-b561-5ff677f1d590 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:58.801881 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-31c6c663-e3d0-4999-b561-5ff677f1d590 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:58.802321 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-31c6c663-e3d0-4999-b561-5ff677f1d590 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:58.803099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-31c6c663-e3d0-4999-b561-5ff677f1d590 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:58.803544 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-31c6c663-e3d0-4999-b561-5ff677f1d590 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:58.934110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-31c6c663-e3d0-4999-b561-5ff677f1d590 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:50:58.941484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-31c6c663-e3d0-4999-b561-5ff677f1d590 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.151406 Jul 20 22:50:58.942037 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 250/499] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:58 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:50:59.686302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cca3d090-703a-47c1-85e9-9b8eaa93bb99 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:50:59.687475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cca3d090-703a-47c1-85e9-9b8eaa93bb99 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:59.693862 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cca3d090-703a-47c1-85e9-9b8eaa93bb99 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:59.694309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cca3d090-703a-47c1-85e9-9b8eaa93bb99 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:59.695087 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cca3d090-703a-47c1-85e9-9b8eaa93bb99 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:59.695522 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cca3d090-703a-47c1-85e9-9b8eaa93bb99 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:59.717953 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-cca3d090-703a-47c1-85e9-9b8eaa93bb99 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lazy-loading 'flavor' on Instance uuid 87967be5-1f31-4e6c-afe0-f3c63923c558 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:50:59.958814 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f9ee938f-ca03-4e83-9f46-d61bfe0a9d28 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:50:59.959465 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f9ee938f-ca03-4e83-9f46-d61bfe0a9d28 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:50:59.965683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9ee938f-ca03-4e83-9f46-d61bfe0a9d28 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:59.966118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9ee938f-ca03-4e83-9f46-d61bfe0a9d28 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:50:59.966963 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9ee938f-ca03-4e83-9f46-d61bfe0a9d28 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:50:59.967423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9ee938f-ca03-4e83-9f46-d61bfe0a9d28 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:00.094079 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f9ee938f-ca03-4e83-9f46-d61bfe0a9d28 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:00.101886 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cca3d090-703a-47c1-85e9-9b8eaa93bb99 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/action" status: 200 len: 32 microversion: 2.1 time: 0.420057 Jul 20 22:51:00.102436 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f9ee938f-ca03-4e83-9f46-d61bfe0a9d28 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.147355 Jul 20 22:51:00.102570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 250/500] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:50:59 2022] POST /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:51:00.102999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 251/501] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:50:59 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:00.112160 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-596e76f1-c35f-47ba-a988-1412c6838fa3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:00.112863 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-596e76f1-c35f-47ba-a988-1412c6838fa3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:00.119763 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-596e76f1-c35f-47ba-a988-1412c6838fa3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:00.120214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-596e76f1-c35f-47ba-a988-1412c6838fa3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:00.120974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-596e76f1-c35f-47ba-a988-1412c6838fa3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:00.121408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-596e76f1-c35f-47ba-a988-1412c6838fa3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:00.248506 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-596e76f1-c35f-47ba-a988-1412c6838fa3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:00.256491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-596e76f1-c35f-47ba-a988-1412c6838fa3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.148243 Jul 20 22:51:00.257057 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 251/502] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:00 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:01.119802 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-39fcde9c-ac51-43f7-b053-edf982456e4a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:01.120439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-39fcde9c-ac51-43f7-b053-edf982456e4a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:01.126901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-39fcde9c-ac51-43f7-b053-edf982456e4a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:01.127384 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-39fcde9c-ac51-43f7-b053-edf982456e4a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:01.128134 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-39fcde9c-ac51-43f7-b053-edf982456e4a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:01.128567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-39fcde9c-ac51-43f7-b053-edf982456e4a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:01.257015 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-39fcde9c-ac51-43f7-b053-edf982456e4a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:01.264776 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-39fcde9c-ac51-43f7-b053-edf982456e4a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.149395 Jul 20 22:51:01.275703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 252/503] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:01 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:01.275845 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7284be00-8123-47b5-b2e2-bc913e63f2d4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:01.275845 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7284be00-8123-47b5-b2e2-bc913e63f2d4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:01.281633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7284be00-8123-47b5-b2e2-bc913e63f2d4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:01.282082 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7284be00-8123-47b5-b2e2-bc913e63f2d4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:01.282846 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7284be00-8123-47b5-b2e2-bc913e63f2d4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:01.283307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7284be00-8123-47b5-b2e2-bc913e63f2d4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:01.414352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7284be00-8123-47b5-b2e2-bc913e63f2d4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:01.422792 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7284be00-8123-47b5-b2e2-bc913e63f2d4 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.153121 Jul 20 22:51:01.423474 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 252/504] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:01 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:02.281978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-23d7976b-6c00-4fed-8863-49f98f558c81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:02.282578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-23d7976b-6c00-4fed-8863-49f98f558c81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:02.289033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-23d7976b-6c00-4fed-8863-49f98f558c81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:02.289464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-23d7976b-6c00-4fed-8863-49f98f558c81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:02.290218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-23d7976b-6c00-4fed-8863-49f98f558c81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:02.290652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-23d7976b-6c00-4fed-8863-49f98f558c81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:02.423273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-23d7976b-6c00-4fed-8863-49f98f558c81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:02.431675 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-23d7976b-6c00-4fed-8863-49f98f558c81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.153517 Jul 20 22:51:02.432242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 253/505] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:02 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:02.441288 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5b5b5f9c-8448-462d-bbe7-b6d4e4d819bd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:02.442231 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5b5b5f9c-8448-462d-bbe7-b6d4e4d819bd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:02.450177 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b5b5f9c-8448-462d-bbe7-b6d4e4d819bd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:02.450745 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b5b5f9c-8448-462d-bbe7-b6d4e4d819bd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:02.451871 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b5b5f9c-8448-462d-bbe7-b6d4e4d819bd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:02.452519 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b5b5f9c-8448-462d-bbe7-b6d4e4d819bd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:02.584622 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5b5b5f9c-8448-462d-bbe7-b6d4e4d819bd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:02.593551 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5b5b5f9c-8448-462d-bbe7-b6d4e4d819bd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.157251 Jul 20 22:51:02.598345 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 253/506] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:02 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:03.448630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-89b057b0-c7e8-4217-98ab-16705f6f8a38 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:03.449239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-89b057b0-c7e8-4217-98ab-16705f6f8a38 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:03.451198 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:03.456448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-89b057b0-c7e8-4217-98ab-16705f6f8a38 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:03.456897 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-89b057b0-c7e8-4217-98ab-16705f6f8a38 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:03.457658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-89b057b0-c7e8-4217-98ab-16705f6f8a38 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:03.458089 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-89b057b0-c7e8-4217-98ab-16705f6f8a38 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:03.584260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-89b057b0-c7e8-4217-98ab-16705f6f8a38 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:03.592105 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-89b057b0-c7e8-4217-98ab-16705f6f8a38 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.147381 Jul 20 22:51:03.592667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 254/507] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:03 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:03.611265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1a8707fe-fc74-4a79-ac42-67cb4a1f6aed tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:03.611871 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1a8707fe-fc74-4a79-ac42-67cb4a1f6aed tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:03.613778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:03.619037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a8707fe-fc74-4a79-ac42-67cb4a1f6aed tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:03.619510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a8707fe-fc74-4a79-ac42-67cb4a1f6aed tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:03.620266 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a8707fe-fc74-4a79-ac42-67cb4a1f6aed tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:03.620696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a8707fe-fc74-4a79-ac42-67cb4a1f6aed tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:03.749639 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1a8707fe-fc74-4a79-ac42-67cb4a1f6aed tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:03.757635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1a8707fe-fc74-4a79-ac42-67cb4a1f6aed tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.150224 Jul 20 22:51:03.758198 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 254/508] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:03 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:04.609047 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7afe3cef-0d74-407a-8e95-3669f8dccc81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:04.609653 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7afe3cef-0d74-407a-8e95-3669f8dccc81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:04.616700 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7afe3cef-0d74-407a-8e95-3669f8dccc81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:04.617150 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7afe3cef-0d74-407a-8e95-3669f8dccc81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:04.617902 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7afe3cef-0d74-407a-8e95-3669f8dccc81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:04.618332 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7afe3cef-0d74-407a-8e95-3669f8dccc81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:04.748749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7afe3cef-0d74-407a-8e95-3669f8dccc81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:04.756120 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7afe3cef-0d74-407a-8e95-3669f8dccc81 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.150911 Jul 20 22:51:04.756687 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 255/509] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:04 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:04.776289 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-29aae67f-33a3-4320-ac75-937383112b8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:04.776888 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-29aae67f-33a3-4320-ac75-937383112b8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:04.779717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=8 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:04.783895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-29aae67f-33a3-4320-ac75-937383112b8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:04.784337 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-29aae67f-33a3-4320-ac75-937383112b8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:04.785088 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-29aae67f-33a3-4320-ac75-937383112b8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:04.785517 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-29aae67f-33a3-4320-ac75-937383112b8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:04.918656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-29aae67f-33a3-4320-ac75-937383112b8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:04.923675 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-29aae67f-33a3-4320-ac75-937383112b8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.152256 Jul 20 22:51:04.924234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 255/510] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:04 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:05.773912 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-caa18045-6d78-423e-9d44-5fbc198b0753 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:05.774478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-caa18045-6d78-423e-9d44-5fbc198b0753 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:05.781328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-caa18045-6d78-423e-9d44-5fbc198b0753 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:05.781773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-caa18045-6d78-423e-9d44-5fbc198b0753 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:05.782521 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-caa18045-6d78-423e-9d44-5fbc198b0753 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:05.782952 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-caa18045-6d78-423e-9d44-5fbc198b0753 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:05.914129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-caa18045-6d78-423e-9d44-5fbc198b0753 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:05.918756 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-caa18045-6d78-423e-9d44-5fbc198b0753 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.149072 Jul 20 22:51:05.919349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 256/511] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:05 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:05.940548 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-41bf97c6-7e25-4935-af18-795798dfcf88 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:05.941154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-41bf97c6-7e25-4935-af18-795798dfcf88 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:05.948066 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41bf97c6-7e25-4935-af18-795798dfcf88 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:05.948511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41bf97c6-7e25-4935-af18-795798dfcf88 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:05.949263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41bf97c6-7e25-4935-af18-795798dfcf88 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:05.949695 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41bf97c6-7e25-4935-af18-795798dfcf88 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:06.078373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-41bf97c6-7e25-4935-af18-795798dfcf88 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:06.086218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-41bf97c6-7e25-4935-af18-795798dfcf88 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.149423 Jul 20 22:51:06.086787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 256/512] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:05 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:06.936070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-94329e4b-7e76-435f-9a28-f38a203ae5dc tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:06.936776 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-94329e4b-7e76-435f-9a28-f38a203ae5dc tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:06.943376 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-94329e4b-7e76-435f-9a28-f38a203ae5dc tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:06.949587 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-94329e4b-7e76-435f-9a28-f38a203ae5dc tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:06.949587 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-94329e4b-7e76-435f-9a28-f38a203ae5dc tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:06.949587 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-94329e4b-7e76-435f-9a28-f38a203ae5dc tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:06.973124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-3be28c2d-e2f0-4dd5-8489-2eaf8b10273f req-9cd74417-24f1-4be8-bc01-2f36cac512c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e03f98-910e-4eeb-a14d-e06495d39bc2", "name": "network-vif-plugged", "status": "completed", "tag": "0efce0f9-7d60-43a9-959f-b7ebca9cd95d"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:51:06.982311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-3be28c2d-e2f0-4dd5-8489-2eaf8b10273f req-9cd74417-24f1-4be8-bc01-2f36cac512c9 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:06.982752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-3be28c2d-e2f0-4dd5-8489-2eaf8b10273f req-9cd74417-24f1-4be8-bc01-2f36cac512c9 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:06.994107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-3be28c2d-e2f0-4dd5-8489-2eaf8b10273f req-9cd74417-24f1-4be8-bc01-2f36cac512c9 service nova] Creating event network-vif-plugged:0efce0f9-7d60-43a9-959f-b7ebca9cd95d for instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 on hv-cinder-79987 Jul 20 22:51:06.999395 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-3be28c2d-e2f0-4dd5-8489-2eaf8b10273f req-9cd74417-24f1-4be8-bc01-2f36cac512c9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030153 Jul 20 22:51:07.008813 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 257/513] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:51:07.081077 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-94329e4b-7e76-435f-9a28-f38a203ae5dc tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:07.089092 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-94329e4b-7e76-435f-9a28-f38a203ae5dc tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.156867 Jul 20 22:51:07.090258 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 257/514] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:06 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:07.104340 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-afbb42f7-5397-4e02-ad95-47c7ae32c1f2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:07.105038 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-afbb42f7-5397-4e02-ad95-47c7ae32c1f2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:07.111225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-afbb42f7-5397-4e02-ad95-47c7ae32c1f2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:07.111670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-afbb42f7-5397-4e02-ad95-47c7ae32c1f2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:07.112436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-afbb42f7-5397-4e02-ad95-47c7ae32c1f2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:07.112873 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-afbb42f7-5397-4e02-ad95-47c7ae32c1f2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:07.251369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-afbb42f7-5397-4e02-ad95-47c7ae32c1f2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:07.259902 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-afbb42f7-5397-4e02-ad95-47c7ae32c1f2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.159040 Jul 20 22:51:07.260583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 258/515] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:07 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:08.106143 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-69c91011-ef80-4128-b36f-e6771dc8ac65 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:08.106747 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-69c91011-ef80-4128-b36f-e6771dc8ac65 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:08.113226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-69c91011-ef80-4128-b36f-e6771dc8ac65 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:08.113669 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-69c91011-ef80-4128-b36f-e6771dc8ac65 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:08.114422 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-69c91011-ef80-4128-b36f-e6771dc8ac65 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:08.114851 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-69c91011-ef80-4128-b36f-e6771dc8ac65 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:08.244464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-69c91011-ef80-4128-b36f-e6771dc8ac65 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:08.251867 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-69c91011-ef80-4128-b36f-e6771dc8ac65 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.149577 Jul 20 22:51:08.252434 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 258/516] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:08 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:08.277821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0e906343-69ea-4096-82c8-61c4ec50b7cc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:08.278432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0e906343-69ea-4096-82c8-61c4ec50b7cc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:08.285531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0e906343-69ea-4096-82c8-61c4ec50b7cc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:08.286077 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0e906343-69ea-4096-82c8-61c4ec50b7cc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:08.286856 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0e906343-69ea-4096-82c8-61c4ec50b7cc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:08.287330 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0e906343-69ea-4096-82c8-61c4ec50b7cc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:08.417741 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0e906343-69ea-4096-82c8-61c4ec50b7cc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:08.425962 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0e906343-69ea-4096-82c8-61c4ec50b7cc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.152188 Jul 20 22:51:08.426560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 259/517] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:08 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:09.325751 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5d777022-75d6-4ae4-8a12-76f76f94a757 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:09.326357 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-5d777022-75d6-4ae4-8a12-76f76f94a757 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:09.332856 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d777022-75d6-4ae4-8a12-76f76f94a757 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:09.334635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d777022-75d6-4ae4-8a12-76f76f94a757 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:09.334635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d777022-75d6-4ae4-8a12-76f76f94a757 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:09.334635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d777022-75d6-4ae4-8a12-76f76f94a757 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:09.443185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6a913277-f175-4a11-b143-7961ba1831bc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:09.443783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6a913277-f175-4a11-b143-7961ba1831bc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:09.451379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a913277-f175-4a11-b143-7961ba1831bc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:09.451752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a913277-f175-4a11-b143-7961ba1831bc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:09.452540 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a913277-f175-4a11-b143-7961ba1831bc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:09.452970 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a913277-f175-4a11-b143-7961ba1831bc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:09.473170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-5d777022-75d6-4ae4-8a12-76f76f94a757 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:09.480886 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5d777022-75d6-4ae4-8a12-76f76f94a757 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1319 microversion: 2.1 time: 0.159575 Jul 20 22:51:09.481450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 259/518] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:09 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:09.582262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6a913277-f175-4a11-b143-7961ba1831bc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:09.590104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6a913277-f175-4a11-b143-7961ba1831bc tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.150793 Jul 20 22:51:09.590651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 260/519] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:09 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:10.498281 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6544c0e8-7ba5-4058-b290-037787e801ba tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:10.498845 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6544c0e8-7ba5-4058-b290-037787e801ba tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:10.505288 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6544c0e8-7ba5-4058-b290-037787e801ba tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:10.505734 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6544c0e8-7ba5-4058-b290-037787e801ba tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:10.506491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6544c0e8-7ba5-4058-b290-037787e801ba tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:10.506923 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6544c0e8-7ba5-4058-b290-037787e801ba tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:10.608089 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ff36f4b7-ef3e-4a39-a778-ad4114a6d784 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:10.608785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ff36f4b7-ef3e-4a39-a778-ad4114a6d784 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:10.614758 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ff36f4b7-ef3e-4a39-a778-ad4114a6d784 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:10.615231 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ff36f4b7-ef3e-4a39-a778-ad4114a6d784 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:10.615981 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ff36f4b7-ef3e-4a39-a778-ad4114a6d784 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:10.616407 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ff36f4b7-ef3e-4a39-a778-ad4114a6d784 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:10.633209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6544c0e8-7ba5-4058-b290-037787e801ba tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:10.640571 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6544c0e8-7ba5-4058-b290-037787e801ba tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1507 microversion: 2.1 time: 0.146788 Jul 20 22:51:10.641138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 260/520] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:10 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:10.657005 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-33090010-0f3f-49ba-93b3-5c64235414f6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "246a748d-4bf6-4a96-b8a5-c315af7874a6", "device": "/dev/sdb"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:51:10.658095 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-33090010-0f3f-49ba-93b3-5c64235414f6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:10.664242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-33090010-0f3f-49ba-93b3-5c64235414f6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:10.664685 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-33090010-0f3f-49ba-93b3-5c64235414f6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:10.665448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-33090010-0f3f-49ba-93b3-5c64235414f6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:10.665880 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-33090010-0f3f-49ba-93b3-5c64235414f6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:10.745230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ff36f4b7-ef3e-4a39-a778-ad4114a6d784 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:10.753200 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ff36f4b7-ef3e-4a39-a778-ad4114a6d784 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.149632 Jul 20 22:51:10.753698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 261/521] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:10 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:11.771049 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-da468710-5722-4a25-b3e6-a2d49211ba9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:11.771830 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-da468710-5722-4a25-b3e6-a2d49211ba9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:11.778104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da468710-5722-4a25-b3e6-a2d49211ba9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:11.778551 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da468710-5722-4a25-b3e6-a2d49211ba9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:11.779406 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da468710-5722-4a25-b3e6-a2d49211ba9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:11.779848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da468710-5722-4a25-b3e6-a2d49211ba9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:11.911465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-da468710-5722-4a25-b3e6-a2d49211ba9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:11.914864 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:11.920140 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-da468710-5722-4a25-b3e6-a2d49211ba9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.153213 Jul 20 22:51:11.920701 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 262/522] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:11 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:12.012654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:12.131081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-33090010-0f3f-49ba-93b3-5c64235414f6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "POST /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.477506 Jul 20 22:51:12.131957 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 261/523] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:51:10 2022] POST /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2/os-volume_attachments => generated 194 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:51:12.937561 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b805a9bf-2abf-4669-9703-8b63c15e39fe tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:12.938170 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b805a9bf-2abf-4669-9703-8b63c15e39fe tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:12.945887 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b805a9bf-2abf-4669-9703-8b63c15e39fe tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:12.946340 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b805a9bf-2abf-4669-9703-8b63c15e39fe tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:12.947137 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b805a9bf-2abf-4669-9703-8b63c15e39fe tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:12.947575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b805a9bf-2abf-4669-9703-8b63c15e39fe tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:13.079130 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b805a9bf-2abf-4669-9703-8b63c15e39fe tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:13.086891 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b805a9bf-2abf-4669-9703-8b63c15e39fe tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.153284 Jul 20 22:51:13.087481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 263/524] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:12 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:14.105306 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8014e483-1954-4ad4-a515-0f4a1d8e06fa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:14.106048 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8014e483-1954-4ad4-a515-0f4a1d8e06fa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:14.112922 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8014e483-1954-4ad4-a515-0f4a1d8e06fa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:14.113370 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8014e483-1954-4ad4-a515-0f4a1d8e06fa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:14.114123 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8014e483-1954-4ad4-a515-0f4a1d8e06fa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:14.114557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8014e483-1954-4ad4-a515-0f4a1d8e06fa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:14.246634 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8014e483-1954-4ad4-a515-0f4a1d8e06fa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:14.254617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8014e483-1954-4ad4-a515-0f4a1d8e06fa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.153994 Jul 20 22:51:14.255223 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 262/525] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:14 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:15.273083 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a6dbd814-da2d-452e-8d84-c2c9e87833df tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:15.273690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a6dbd814-da2d-452e-8d84-c2c9e87833df tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:15.280797 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a6dbd814-da2d-452e-8d84-c2c9e87833df tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:15.281245 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a6dbd814-da2d-452e-8d84-c2c9e87833df tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:15.282004 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a6dbd814-da2d-452e-8d84-c2c9e87833df tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:15.282436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a6dbd814-da2d-452e-8d84-c2c9e87833df tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:15.411186 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a6dbd814-da2d-452e-8d84-c2c9e87833df tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:15.419657 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a6dbd814-da2d-452e-8d84-c2c9e87833df tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.151031 Jul 20 22:51:15.420213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 264/526] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:15 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:16.437116 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c2f1bb67-d1e9-4475-8fdb-c5c218648ecd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:16.437725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c2f1bb67-d1e9-4475-8fdb-c5c218648ecd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:16.444301 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2f1bb67-d1e9-4475-8fdb-c5c218648ecd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:16.444748 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2f1bb67-d1e9-4475-8fdb-c5c218648ecd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:16.445545 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2f1bb67-d1e9-4475-8fdb-c5c218648ecd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:16.445929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2f1bb67-d1e9-4475-8fdb-c5c218648ecd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:16.570564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c2f1bb67-d1e9-4475-8fdb-c5c218648ecd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:16.578466 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c2f1bb67-d1e9-4475-8fdb-c5c218648ecd tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.145720 Jul 20 22:51:16.579054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 263/527] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:16 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:17.596261 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-46c8a90b-8d52-4554-a479-bfa014c7a62b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:17.596862 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-46c8a90b-8d52-4554-a479-bfa014c7a62b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:17.603462 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-46c8a90b-8d52-4554-a479-bfa014c7a62b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:17.603896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-46c8a90b-8d52-4554-a479-bfa014c7a62b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:17.604673 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-46c8a90b-8d52-4554-a479-bfa014c7a62b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:17.605113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-46c8a90b-8d52-4554-a479-bfa014c7a62b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:17.965510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-46c8a90b-8d52-4554-a479-bfa014c7a62b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:17.965510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-46c8a90b-8d52-4554-a479-bfa014c7a62b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.372584 Jul 20 22:51:17.965510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 265/528] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:17 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:18.981601 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a99d9291-f713-4efc-a511-e942e950af8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:18.982203 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a99d9291-f713-4efc-a511-e942e950af8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:18.984619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=38 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:18.989338 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a99d9291-f713-4efc-a511-e942e950af8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:18.989778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a99d9291-f713-4efc-a511-e942e950af8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:18.990528 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a99d9291-f713-4efc-a511-e942e950af8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:18.990954 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a99d9291-f713-4efc-a511-e942e950af8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:19.122303 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a99d9291-f713-4efc-a511-e942e950af8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:19.130908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a99d9291-f713-4efc-a511-e942e950af8f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.153094 Jul 20 22:51:19.131496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 264/529] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:18 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:20.149027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-471bedc1-13da-4e50-8054-a08d5ab7dc4e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:20.149558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-471bedc1-13da-4e50-8054-a08d5ab7dc4e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:20.156063 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-471bedc1-13da-4e50-8054-a08d5ab7dc4e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:20.156508 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-471bedc1-13da-4e50-8054-a08d5ab7dc4e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:20.157268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-471bedc1-13da-4e50-8054-a08d5ab7dc4e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:20.157701 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-471bedc1-13da-4e50-8054-a08d5ab7dc4e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:20.288509 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-471bedc1-13da-4e50-8054-a08d5ab7dc4e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:20.296828 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-471bedc1-13da-4e50-8054-a08d5ab7dc4e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.151952 Jul 20 22:51:20.297385 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 266/530] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:20 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:21.313959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9b48fa11-e3e5-43a4-bbe3-5bc7517e65a1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:21.314564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9b48fa11-e3e5-43a4-bbe3-5bc7517e65a1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:21.321265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b48fa11-e3e5-43a4-bbe3-5bc7517e65a1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:21.327958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b48fa11-e3e5-43a4-bbe3-5bc7517e65a1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:21.327958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b48fa11-e3e5-43a4-bbe3-5bc7517e65a1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:21.327958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9b48fa11-e3e5-43a4-bbe3-5bc7517e65a1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:21.455650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9b48fa11-e3e5-43a4-bbe3-5bc7517e65a1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:21.463694 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9b48fa11-e3e5-43a4-bbe3-5bc7517e65a1 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.153586 Jul 20 22:51:21.464260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 265/531] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:21 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:22.333381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-88ffc79a-460d-436f-95ca-1c619c3d36f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:22.334009 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-88ffc79a-460d-436f-95ca-1c619c3d36f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:22.340046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88ffc79a-460d-436f-95ca-1c619c3d36f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:22.340492 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88ffc79a-460d-436f-95ca-1c619c3d36f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:22.341246 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88ffc79a-460d-436f-95ca-1c619c3d36f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:22.341678 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88ffc79a-460d-436f-95ca-1c619c3d36f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:22.421337 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-88ffc79a-460d-436f-95ca-1c619c3d36f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lazy-loading 'services' on Instance uuid cce8a500-8166-4cb3-bc33-41c35ef48651 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:51:22.481058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d7df3944-5fee-4137-92c1-eb725297862e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:22.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d7df3944-5fee-4137-92c1-eb725297862e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:22.488192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d7df3944-5fee-4137-92c1-eb725297862e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:22.488669 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d7df3944-5fee-4137-92c1-eb725297862e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:22.489409 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d7df3944-5fee-4137-92c1-eb725297862e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:22.489833 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d7df3944-5fee-4137-92c1-eb725297862e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:22.650393 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-88ffc79a-460d-436f-95ca-1c619c3d36f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/os-volume_attachments/41ab6f4c-bded-4fee-ae6e-430988f82473" status: 202 len: 0 microversion: 2.1 time: 0.425369 Jul 20 22:51:22.652029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 267/532] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:51:22 2022] DELETE /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/os-volume_attachments/41ab6f4c-bded-4fee-ae6e-430988f82473 => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:51:22.853463 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d7df3944-5fee-4137-92c1-eb725297862e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:22.861547 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d7df3944-5fee-4137-92c1-eb725297862e tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.384174 Jul 20 22:51:22.862109 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 266/533] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:22 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:23.880855 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1e0c9db5-bebf-4475-b759-fdc9561a4b2b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:23.881547 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1e0c9db5-bebf-4475-b759-fdc9561a4b2b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:23.883456 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:23.888457 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1e0c9db5-bebf-4475-b759-fdc9561a4b2b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:23.888903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1e0c9db5-bebf-4475-b759-fdc9561a4b2b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:23.889659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1e0c9db5-bebf-4475-b759-fdc9561a4b2b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:23.890145 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1e0c9db5-bebf-4475-b759-fdc9561a4b2b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:24.022176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1e0c9db5-bebf-4475-b759-fdc9561a4b2b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:24.030134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1e0c9db5-bebf-4475-b759-fdc9561a4b2b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.153989 Jul 20 22:51:24.030691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 268/534] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:23 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:25.047348 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-bb85b434-3494-4c13-9e81-0a67fc9f9475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:25.047888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-bb85b434-3494-4c13-9e81-0a67fc9f9475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:25.054434 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb85b434-3494-4c13-9e81-0a67fc9f9475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:25.054881 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb85b434-3494-4c13-9e81-0a67fc9f9475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:25.055670 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb85b434-3494-4c13-9e81-0a67fc9f9475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:25.056108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb85b434-3494-4c13-9e81-0a67fc9f9475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:25.185601 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-bb85b434-3494-4c13-9e81-0a67fc9f9475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:25.194265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-bb85b434-3494-4c13-9e81-0a67fc9f9475 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.150835 Jul 20 22:51:25.195063 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 267/535] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:25 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:26.211544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-02e8283e-1ae6-4554-ab8b-e22d4cb26122 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:26.212157 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-02e8283e-1ae6-4554-ab8b-e22d4cb26122 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:26.218776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02e8283e-1ae6-4554-ab8b-e22d4cb26122 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:26.219272 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02e8283e-1ae6-4554-ab8b-e22d4cb26122 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:26.220033 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02e8283e-1ae6-4554-ab8b-e22d4cb26122 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:26.220503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02e8283e-1ae6-4554-ab8b-e22d4cb26122 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:26.348453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-02e8283e-1ae6-4554-ab8b-e22d4cb26122 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:26.356335 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-02e8283e-1ae6-4554-ab8b-e22d4cb26122 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.148527 Jul 20 22:51:26.356894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 269/536] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:26 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:27.373869 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2fe5321f-9d8a-426a-8408-49877e32cdef tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:27.374464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2fe5321f-9d8a-426a-8408-49877e32cdef tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:27.381416 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2fe5321f-9d8a-426a-8408-49877e32cdef tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:27.381851 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2fe5321f-9d8a-426a-8408-49877e32cdef tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:27.382665 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2fe5321f-9d8a-426a-8408-49877e32cdef tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:27.383231 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2fe5321f-9d8a-426a-8408-49877e32cdef tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:27.517146 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2fe5321f-9d8a-426a-8408-49877e32cdef tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:27.525442 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2fe5321f-9d8a-426a-8408-49877e32cdef tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1736 microversion: 2.1 time: 0.156286 Jul 20 22:51:27.526017 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 268/537] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:27 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:28.542759 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f9f9281a-97e9-4f7e-8d21-74fb38d63bb2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:28.543396 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f9f9281a-97e9-4f7e-8d21-74fb38d63bb2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:28.549989 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f9f9281a-97e9-4f7e-8d21-74fb38d63bb2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:28.550430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f9f9281a-97e9-4f7e-8d21-74fb38d63bb2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:28.551218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f9f9281a-97e9-4f7e-8d21-74fb38d63bb2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:28.551654 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f9f9281a-97e9-4f7e-8d21-74fb38d63bb2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:28.686310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f9f9281a-97e9-4f7e-8d21-74fb38d63bb2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:28.694488 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f9f9281a-97e9-4f7e-8d21-74fb38d63bb2 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1716 microversion: 2.1 time: 0.155611 Jul 20 22:51:28.695056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 270/538] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:28 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:28.747541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:28.748827 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:28.755515 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:28.755952 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:28.756740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:28.757168 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:28.879331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] HTTP exception thrown: Cannot 'detach_volume' instance 87967be5-1f31-4e6c-afe0-f3c63923c558 while it is in vm_state rescued Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Request method failure captured: Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: DELETE /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments/37dc87b6-46ba-4422-8f33-14e3c2e74060 HTTP/1.1 Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWQRNS5QEz_nIx7JpWo3eYPJN2oyFpU7Oa8tzB_exObv7ffo-e51nONWbNwbw_pURsJUKw8Q9iXUPR0igSGfrFxGoD4dwenCxyjEfmDfXIFNCANufGETvsNlinmX78kKFdqLWyz0d4rSgkr5GWAaNPLzpYmmxW3UJtAqqDUqn7ZiCE Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:51:28.880908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_55c688e93c2b414ca86a3c2f9ec84798", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 1ed9249b2a9b42d9972ed71c04f2c888 Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:51:28.882491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Cannot 'detach_volume' instance 87967be5-1f31-4e6c-afe0-f3c63923c558 while it is in vm_state rescued Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'server_id': '87967be5-1f31-4e6c-afe0-f3c63923c558', 'id': '37dc87b6-46ba-4422-8f33-14e3c2e74060'} Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 87967be5-1f31-4e6c-afe0-f3c63923c558 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:51:28.883404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 87967be5-1f31-4e6c-afe0-f3c63923c558 while it is in vm_state rescued Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 87967be5-1f31-4e6c-afe0-f3c63923c558 while it is in vm_state rescued Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:28.885007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Returning 409 to user: Cannot 'detach_volume' instance 87967be5-1f31-4e6c-afe0-f3c63923c558 while it is in vm_state rescued {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:51:28.886242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e1ecc16a-4eb8-4b37-9a33-c4a0bba9d997 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments/37dc87b6-46ba-4422-8f33-14e3c2e74060" status: 409 len: 152 microversion: 2.1 time: 0.138955 Jul 20 22:51:28.886242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 269/539] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:51:28 2022] DELETE /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments/37dc87b6-46ba-4422-8f33-14e3c2e74060 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 22:51:28.891689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-39b6138c-6e18-48f6-b50a-3da29e8828f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:51:28.892224 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-39b6138c-6e18-48f6-b50a-3da29e8828f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:28.898355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-39b6138c-6e18-48f6-b50a-3da29e8828f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:28.898800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-39b6138c-6e18-48f6-b50a-3da29e8828f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:28.899587 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-39b6138c-6e18-48f6-b50a-3da29e8828f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:28.900018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-39b6138c-6e18-48f6-b50a-3da29e8828f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:29.230524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-39b6138c-6e18-48f6-b50a-3da29e8828f3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "POST /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/action" status: 202 len: 0 microversion: 2.1 time: 0.343076 Jul 20 22:51:29.237190 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 271/540] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:51:28 2022] POST /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:51:29.239630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cc7308a5-8365-4713-b9c6-3f508500a51d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:29.241012 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cc7308a5-8365-4713-b9c6-3f508500a51d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:29.246913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc7308a5-8365-4713-b9c6-3f508500a51d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:29.247393 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc7308a5-8365-4713-b9c6-3f508500a51d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:29.248154 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc7308a5-8365-4713-b9c6-3f508500a51d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:29.249157 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc7308a5-8365-4713-b9c6-3f508500a51d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:29.380940 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cc7308a5-8365-4713-b9c6-3f508500a51d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:29.391668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cc7308a5-8365-4713-b9c6-3f508500a51d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1724 microversion: 2.1 time: 0.155754 Jul 20 22:51:29.392444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 270/541] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:29 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:30.098272 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d730249a-7047-49fc-a8b6-0860062cd8cc tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:51:30.104415 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d730249a-7047-49fc-a8b6-0860062cd8cc tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:30.107047 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d730249a-7047-49fc-a8b6-0860062cd8cc tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:30.127556 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d730249a-7047-49fc-a8b6-0860062cd8cc tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Going to try to stop instance {{(pid=124913) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 22:51:30.345308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d730249a-7047-49fc-a8b6-0860062cd8cc tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/action" status: 202 len: 0 microversion: 2.1 time: 0.251584 Jul 20 22:51:30.345914 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 272/542] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:51:30 2022] POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 22:51:30.354190 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ea4d1a09-3e87-4775-89bb-8c8f145e9861 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:30.354928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ea4d1a09-3e87-4775-89bb-8c8f145e9861 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:30.361980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ea4d1a09-3e87-4775-89bb-8c8f145e9861 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:30.364193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ea4d1a09-3e87-4775-89bb-8c8f145e9861 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:30.364193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ea4d1a09-3e87-4775-89bb-8c8f145e9861 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:30.364193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ea4d1a09-3e87-4775-89bb-8c8f145e9861 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:30.415305 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8ca32267-5068-4356-bd20-f1360d811ee7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:30.416037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8ca32267-5068-4356-bd20-f1360d811ee7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:30.423696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8ca32267-5068-4356-bd20-f1360d811ee7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:30.424389 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8ca32267-5068-4356-bd20-f1360d811ee7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:30.425161 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8ca32267-5068-4356-bd20-f1360d811ee7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:30.425598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8ca32267-5068-4356-bd20-f1360d811ee7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:30.497414 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ea4d1a09-3e87-4775-89bb-8c8f145e9861 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:30.505509 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ea4d1a09-3e87-4775-89bb-8c8f145e9861 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.155310 Jul 20 22:51:30.506076 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 271/543] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:30 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:30.556332 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8ca32267-5068-4356-bd20-f1360d811ee7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:30.564901 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8ca32267-5068-4356-bd20-f1360d811ee7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1724 microversion: 2.1 time: 0.153839 Jul 20 22:51:30.565458 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 273/544] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:30 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:31.524396 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c49029fb-8ca2-4b42-bfbb-f425a8895440 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:31.524920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c49029fb-8ca2-4b42-bfbb-f425a8895440 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:31.531444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c49029fb-8ca2-4b42-bfbb-f425a8895440 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:31.531889 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c49029fb-8ca2-4b42-bfbb-f425a8895440 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:31.532646 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c49029fb-8ca2-4b42-bfbb-f425a8895440 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:31.533075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c49029fb-8ca2-4b42-bfbb-f425a8895440 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:31.581820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-facba57d-2344-4118-86e6-31e5eca82b9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:31.582419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-facba57d-2344-4118-86e6-31e5eca82b9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:31.589022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-facba57d-2344-4118-86e6-31e5eca82b9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:31.589505 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-facba57d-2344-4118-86e6-31e5eca82b9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:31.590258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-facba57d-2344-4118-86e6-31e5eca82b9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:31.590850 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-facba57d-2344-4118-86e6-31e5eca82b9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:31.666780 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c49029fb-8ca2-4b42-bfbb-f425a8895440 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:31.676915 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c49029fb-8ca2-4b42-bfbb-f425a8895440 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.156411 Jul 20 22:51:31.680236 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 272/545] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:31 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:31.723597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-facba57d-2344-4118-86e6-31e5eca82b9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:31.731462 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-facba57d-2344-4118-86e6-31e5eca82b9c tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1724 microversion: 2.1 time: 0.153533 Jul 20 22:51:31.732053 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 274/546] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:31 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:32.694449 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-de98798c-cfcd-46a7-bdb8-e33394e0f998 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:32.695048 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-de98798c-cfcd-46a7-bdb8-e33394e0f998 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:32.702147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de98798c-cfcd-46a7-bdb8-e33394e0f998 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:32.702594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de98798c-cfcd-46a7-bdb8-e33394e0f998 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:32.703376 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de98798c-cfcd-46a7-bdb8-e33394e0f998 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:32.703807 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de98798c-cfcd-46a7-bdb8-e33394e0f998 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:32.749148 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-dad18bd5-05f8-41c0-994c-37d87508d97d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:32.749743 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-dad18bd5-05f8-41c0-994c-37d87508d97d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:32.756269 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dad18bd5-05f8-41c0-994c-37d87508d97d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:32.756718 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dad18bd5-05f8-41c0-994c-37d87508d97d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:32.757510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dad18bd5-05f8-41c0-994c-37d87508d97d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:32.757971 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dad18bd5-05f8-41c0-994c-37d87508d97d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:32.833157 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-de98798c-cfcd-46a7-bdb8-e33394e0f998 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:32.844918 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-de98798c-cfcd-46a7-bdb8-e33394e0f998 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.150295 Jul 20 22:51:32.844918 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 273/547] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:32 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:32.889934 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-dad18bd5-05f8-41c0-994c-37d87508d97d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:32.898237 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-dad18bd5-05f8-41c0-994c-37d87508d97d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1724 microversion: 2.1 time: 0.153285 Jul 20 22:51:32.898811 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 275/548] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:32 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:33.857464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-68b55dd6-2322-496d-8da1-7b34cb69be8e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:33.858055 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-68b55dd6-2322-496d-8da1-7b34cb69be8e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:33.864664 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-68b55dd6-2322-496d-8da1-7b34cb69be8e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:33.865102 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-68b55dd6-2322-496d-8da1-7b34cb69be8e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:33.865842 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-68b55dd6-2322-496d-8da1-7b34cb69be8e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:33.866263 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-68b55dd6-2322-496d-8da1-7b34cb69be8e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:33.915717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c7587c91-9a18-4cc8-9031-301463556f05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:33.916282 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c7587c91-9a18-4cc8-9031-301463556f05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:33.922882 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7587c91-9a18-4cc8-9031-301463556f05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:33.925790 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7587c91-9a18-4cc8-9031-301463556f05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:33.925790 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7587c91-9a18-4cc8-9031-301463556f05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:33.925790 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7587c91-9a18-4cc8-9031-301463556f05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:34.007209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-68b55dd6-2322-496d-8da1-7b34cb69be8e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:34.015506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-68b55dd6-2322-496d-8da1-7b34cb69be8e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.161719 Jul 20 22:51:34.017498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 274/549] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:33 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:34.059286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c7587c91-9a18-4cc8-9031-301463556f05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:34.063362 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:34.068168 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c7587c91-9a18-4cc8-9031-301463556f05 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1724 microversion: 2.1 time: 0.156336 Jul 20 22:51:34.068749 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 276/550] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:33 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:35.033145 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b403ad3e-342b-4c34-92f1-a17c0541138e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:35.033737 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b403ad3e-342b-4c34-92f1-a17c0541138e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:35.040143 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b403ad3e-342b-4c34-92f1-a17c0541138e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:35.040577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b403ad3e-342b-4c34-92f1-a17c0541138e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:35.041317 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b403ad3e-342b-4c34-92f1-a17c0541138e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:35.041744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b403ad3e-342b-4c34-92f1-a17c0541138e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:35.085641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f0052f7f-7973-498d-919b-d74cd5cc4888 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:35.086249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f0052f7f-7973-498d-919b-d74cd5cc4888 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:35.094189 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f0052f7f-7973-498d-919b-d74cd5cc4888 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:35.094647 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f0052f7f-7973-498d-919b-d74cd5cc4888 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:35.095430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f0052f7f-7973-498d-919b-d74cd5cc4888 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:35.095866 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f0052f7f-7973-498d-919b-d74cd5cc4888 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:35.174060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b403ad3e-342b-4c34-92f1-a17c0541138e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:35.182652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b403ad3e-342b-4c34-92f1-a17c0541138e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.153810 Jul 20 22:51:35.183666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 275/551] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:35 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:35.232727 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f0052f7f-7973-498d-919b-d74cd5cc4888 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:35.240747 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f0052f7f-7973-498d-919b-d74cd5cc4888 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1724 microversion: 2.1 time: 0.158949 Jul 20 22:51:35.241254 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 277/552] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:35 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:36.199581 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c89416dd-b2bf-4d7b-9a46-4c7f77a7a320 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:36.200188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c89416dd-b2bf-4d7b-9a46-4c7f77a7a320 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:36.207277 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c89416dd-b2bf-4d7b-9a46-4c7f77a7a320 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:36.207724 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c89416dd-b2bf-4d7b-9a46-4c7f77a7a320 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:36.208477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c89416dd-b2bf-4d7b-9a46-4c7f77a7a320 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:36.208909 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c89416dd-b2bf-4d7b-9a46-4c7f77a7a320 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:36.256998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-93f62502-c5df-4816-87d6-bca972090168 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:36.257600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-93f62502-c5df-4816-87d6-bca972090168 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:36.264828 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-93f62502-c5df-4816-87d6-bca972090168 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:36.265272 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-93f62502-c5df-4816-87d6-bca972090168 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:36.266036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-93f62502-c5df-4816-87d6-bca972090168 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:36.266466 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-93f62502-c5df-4816-87d6-bca972090168 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:36.350741 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c89416dd-b2bf-4d7b-9a46-4c7f77a7a320 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:36.358632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c89416dd-b2bf-4d7b-9a46-4c7f77a7a320 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.162715 Jul 20 22:51:36.359449 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 276/553] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:36 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:36.402033 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-93f62502-c5df-4816-87d6-bca972090168 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:36.410080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-93f62502-c5df-4816-87d6-bca972090168 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1724 microversion: 2.1 time: 0.157006 Jul 20 22:51:36.410640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 278/554] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:36 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:37.375679 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7739ea18-51eb-40f0-b7fc-c688de2e91bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:37.379681 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7739ea18-51eb-40f0-b7fc-c688de2e91bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:37.385019 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7739ea18-51eb-40f0-b7fc-c688de2e91bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:37.385640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7739ea18-51eb-40f0-b7fc-c688de2e91bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:37.386410 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7739ea18-51eb-40f0-b7fc-c688de2e91bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:37.387025 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7739ea18-51eb-40f0-b7fc-c688de2e91bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:37.427277 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4515dea7-db27-4759-9391-865b6ffa0647 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:37.427986 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4515dea7-db27-4759-9391-865b6ffa0647 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:37.434470 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4515dea7-db27-4759-9391-865b6ffa0647 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:37.434917 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4515dea7-db27-4759-9391-865b6ffa0647 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:37.435928 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4515dea7-db27-4759-9391-865b6ffa0647 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:37.436211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4515dea7-db27-4759-9391-865b6ffa0647 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:37.522506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7739ea18-51eb-40f0-b7fc-c688de2e91bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:37.531000 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7739ea18-51eb-40f0-b7fc-c688de2e91bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.158526 Jul 20 22:51:37.531600 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 277/555] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:37 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:37.574658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4515dea7-db27-4759-9391-865b6ffa0647 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:37.583187 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4515dea7-db27-4759-9391-865b6ffa0647 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1724 microversion: 2.1 time: 0.159778 Jul 20 22:51:37.583746 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 279/556] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:37 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:38.547857 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-dcae39ff-dea0-4c2b-bb6f-627424fd1a16 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:38.548465 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-dcae39ff-dea0-4c2b-bb6f-627424fd1a16 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:38.555641 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dcae39ff-dea0-4c2b-bb6f-627424fd1a16 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:38.560507 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dcae39ff-dea0-4c2b-bb6f-627424fd1a16 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:38.560507 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dcae39ff-dea0-4c2b-bb6f-627424fd1a16 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:38.560507 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dcae39ff-dea0-4c2b-bb6f-627424fd1a16 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:38.572401 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:38.600105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-536a9a96-5ef0-4741-9048-c36ef861c2e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:38.600712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-536a9a96-5ef0-4741-9048-c36ef861c2e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:38.607154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-536a9a96-5ef0-4741-9048-c36ef861c2e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:38.607797 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-536a9a96-5ef0-4741-9048-c36ef861c2e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:38.609160 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-536a9a96-5ef0-4741-9048-c36ef861c2e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:38.609587 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-536a9a96-5ef0-4741-9048-c36ef861c2e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:38.690473 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dcae39ff-dea0-4c2b-bb6f-627424fd1a16 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:38.698070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-dcae39ff-dea0-4c2b-bb6f-627424fd1a16 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.154579 Jul 20 22:51:38.698630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 278/557] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:38 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:38.740554 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-536a9a96-5ef0-4741-9048-c36ef861c2e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:38.748421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-536a9a96-5ef0-4741-9048-c36ef861c2e9 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1730 microversion: 2.1 time: 0.152333 Jul 20 22:51:38.749017 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 280/558] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:38 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:38.765159 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ebf7a19d-1408-43bc-ab5c-b67bcd311194 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:38.765645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ebf7a19d-1408-43bc-ab5c-b67bcd311194 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:38.771852 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ebf7a19d-1408-43bc-ab5c-b67bcd311194 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:38.772288 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ebf7a19d-1408-43bc-ab5c-b67bcd311194 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:38.773028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ebf7a19d-1408-43bc-ab5c-b67bcd311194 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:38.773454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ebf7a19d-1408-43bc-ab5c-b67bcd311194 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:38.852756 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ebf7a19d-1408-43bc-ab5c-b67bcd311194 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091569 Jul 20 22:51:38.853346 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 279/559] 10.222.0.81 () {58 vars in 1274 bytes} [Wed Jul 20 22:51:38 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:51:39.597392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-927461ff-e9df-4e11-a618-9822abae121b tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:39.597880 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-927461ff-e9df-4e11-a618-9822abae121b tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:39.604361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-927461ff-e9df-4e11-a618-9822abae121b tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:39.604928 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-927461ff-e9df-4e11-a618-9822abae121b tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:39.605544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-927461ff-e9df-4e11-a618-9822abae121b tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:39.605971 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-927461ff-e9df-4e11-a618-9822abae121b tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:39.684773 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-927461ff-e9df-4e11-a618-9822abae121b tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lazy-loading 'services' on Instance uuid f9e03f98-910e-4eeb-a14d-e06495d39bc2 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:51:39.715558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3a58123b-cdee-4725-ac8a-b390ffd4e7cb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:39.716160 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3a58123b-cdee-4725-ac8a-b390ffd4e7cb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:39.722147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3a58123b-cdee-4725-ac8a-b390ffd4e7cb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:39.722837 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3a58123b-cdee-4725-ac8a-b390ffd4e7cb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:39.723786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3a58123b-cdee-4725-ac8a-b390ffd4e7cb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:39.724219 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3a58123b-cdee-4725-ac8a-b390ffd4e7cb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:39.890097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-927461ff-e9df-4e11-a618-9822abae121b tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2/os-volume_attachments/246a748d-4bf6-4a96-b8a5-c315af7874a6" status: 202 len: 0 microversion: 2.1 time: 0.295779 Jul 20 22:51:39.890841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 281/560] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:51:39 2022] DELETE /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2/os-volume_attachments/246a748d-4bf6-4a96-b8a5-c315af7874a6 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:51:39.917099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3a58123b-cdee-4725-ac8a-b390ffd4e7cb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:39.924675 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3a58123b-cdee-4725-ac8a-b390ffd4e7cb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.213436 Jul 20 22:51:39.925526 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 280/561] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:39 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:39.974414 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-22d47989-2ba1-498e-b8a8-d48e7690663d req-4338dfde-ca9a-4bf1-91b1-de150f05094f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87967be5-1f31-4e6c-afe0-f3c63923c558", "tag": "6cedd83c-eef6-4869-997c-997862003129"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:51:39.982885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-22d47989-2ba1-498e-b8a8-d48e7690663d req-4338dfde-ca9a-4bf1-91b1-de150f05094f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:39.986108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-22d47989-2ba1-498e-b8a8-d48e7690663d req-4338dfde-ca9a-4bf1-91b1-de150f05094f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:39.996463 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-22d47989-2ba1-498e-b8a8-d48e7690663d req-4338dfde-ca9a-4bf1-91b1-de150f05094f service nova] Creating event network-changed:6cedd83c-eef6-4869-997c-997862003129 for instance 87967be5-1f31-4e6c-afe0-f3c63923c558 on hv-cinder-79987 Jul 20 22:51:40.001646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-22d47989-2ba1-498e-b8a8-d48e7690663d req-4338dfde-ca9a-4bf1-91b1-de150f05094f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109274 Jul 20 22:51:40.002227 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 282/562] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:51:40.942041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-35c01300-f711-4d42-8e0b-bfe206171fa9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:40.942644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-35c01300-f711-4d42-8e0b-bfe206171fa9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:40.948958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-35c01300-f711-4d42-8e0b-bfe206171fa9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:40.949401 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-35c01300-f711-4d42-8e0b-bfe206171fa9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:40.950152 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-35c01300-f711-4d42-8e0b-bfe206171fa9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:40.950580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-35c01300-f711-4d42-8e0b-bfe206171fa9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:41.087676 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-35c01300-f711-4d42-8e0b-bfe206171fa9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:41.095240 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-35c01300-f711-4d42-8e0b-bfe206171fa9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.156936 Jul 20 22:51:41.095808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 281/563] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:40 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:42.017014 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-5a6f16fb-daf0-4e00-a245-0295476286ca req-d2af50b3-41a5-40f9-91a7-75a2d69d5460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87967be5-1f31-4e6c-afe0-f3c63923c558", "tag": "6cedd83c-eef6-4869-997c-997862003129"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:51:42.025418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-5a6f16fb-daf0-4e00-a245-0295476286ca req-d2af50b3-41a5-40f9-91a7-75a2d69d5460 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:42.025855 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-5a6f16fb-daf0-4e00-a245-0295476286ca req-d2af50b3-41a5-40f9-91a7-75a2d69d5460 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:42.038717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-5a6f16fb-daf0-4e00-a245-0295476286ca req-d2af50b3-41a5-40f9-91a7-75a2d69d5460 service nova] Creating event network-changed:6cedd83c-eef6-4869-997c-997862003129 for instance 87967be5-1f31-4e6c-afe0-f3c63923c558 on hv-cinder-79987 Jul 20 22:51:42.042392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-5a6f16fb-daf0-4e00-a245-0295476286ca req-d2af50b3-41a5-40f9-91a7-75a2d69d5460 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030522 Jul 20 22:51:42.043369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 283/564] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:51:42.078979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f22db352-be22-4686-8f29-f28f47da4919 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:42.079498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f22db352-be22-4686-8f29-f28f47da4919 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:42.085896 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f22db352-be22-4686-8f29-f28f47da4919 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:42.086351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f22db352-be22-4686-8f29-f28f47da4919 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:42.087143 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f22db352-be22-4686-8f29-f28f47da4919 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:42.087573 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f22db352-be22-4686-8f29-f28f47da4919 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:42.112822 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-02c01edf-f27e-4844-b336-ce53c4e8d808 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:42.118661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-02c01edf-f27e-4844-b336-ce53c4e8d808 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:42.118823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f22db352-be22-4686-8f29-f28f47da4919 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:51:42.120052 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02c01edf-f27e-4844-b336-ce53c4e8d808 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:42.120503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02c01edf-f27e-4844-b336-ce53c4e8d808 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:42.121277 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02c01edf-f27e-4844-b336-ce53c4e8d808 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:42.121709 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02c01edf-f27e-4844-b336-ce53c4e8d808 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:42.325835 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-02c01edf-f27e-4844-b336-ce53c4e8d808 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:42.334292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-02c01edf-f27e-4844-b336-ce53c4e8d808 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.225608 Jul 20 22:51:42.334864 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 284/565] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:42 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:51:42.444387 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f22db352-be22-4686-8f29-f28f47da4919 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 204 len: 0 microversion: 2.1 time: 0.369309 Jul 20 22:51:42.444972 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 282/566] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:51:42 2022] DELETE /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:51:42.453678 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1cc1130c-a47d-46ec-b282-e0796c15424d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:42.459103 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1cc1130c-a47d-46ec-b282-e0796c15424d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:42.460406 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1cc1130c-a47d-46ec-b282-e0796c15424d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:42.460850 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1cc1130c-a47d-46ec-b282-e0796c15424d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:42.461630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1cc1130c-a47d-46ec-b282-e0796c15424d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:42.462060 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1cc1130c-a47d-46ec-b282-e0796c15424d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:42.588788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1cc1130c-a47d-46ec-b282-e0796c15424d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:42.596167 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1cc1130c-a47d-46ec-b282-e0796c15424d tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1513 microversion: 2.1 time: 0.146917 Jul 20 22:51:42.596735 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 285/567] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:42 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:43.351755 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-69191f78-5efc-4431-8313-34864447bf40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:43.352444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-69191f78-5efc-4431-8313-34864447bf40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:43.360926 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-69191f78-5efc-4431-8313-34864447bf40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:43.361408 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-69191f78-5efc-4431-8313-34864447bf40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:43.362292 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-69191f78-5efc-4431-8313-34864447bf40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:43.362735 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-69191f78-5efc-4431-8313-34864447bf40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:43.495184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-69191f78-5efc-4431-8313-34864447bf40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:43.502692 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-69191f78-5efc-4431-8313-34864447bf40 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.155458 Jul 20 22:51:43.503280 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 283/568] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:43 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:43.613824 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-12d13861-8629-49e8-a4c7-d596e69f9fc6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:43.614429 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-12d13861-8629-49e8-a4c7-d596e69f9fc6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:43.620860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-12d13861-8629-49e8-a4c7-d596e69f9fc6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:43.621306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-12d13861-8629-49e8-a4c7-d596e69f9fc6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:43.622054 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-12d13861-8629-49e8-a4c7-d596e69f9fc6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:43.622485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-12d13861-8629-49e8-a4c7-d596e69f9fc6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:43.760629 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-12d13861-8629-49e8-a4c7-d596e69f9fc6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:43.768130 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-12d13861-8629-49e8-a4c7-d596e69f9fc6 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1513 microversion: 2.1 time: 0.158091 Jul 20 22:51:43.768690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 286/569] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:43 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:44.520567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-158051ea-a9eb-433c-9c25-d656a094d12c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:44.521176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-158051ea-a9eb-433c-9c25-d656a094d12c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:44.527707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-158051ea-a9eb-433c-9c25-d656a094d12c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:44.528152 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-158051ea-a9eb-433c-9c25-d656a094d12c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:44.528907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-158051ea-a9eb-433c-9c25-d656a094d12c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:44.529343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-158051ea-a9eb-433c-9c25-d656a094d12c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:44.659504 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-158051ea-a9eb-433c-9c25-d656a094d12c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:44.666942 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-158051ea-a9eb-433c-9c25-d656a094d12c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.151001 Jul 20 22:51:44.667534 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 284/570] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:44 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:44.786227 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-65408e03-2e17-416b-98a6-a88bcb85dcb0 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:44.786771 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-65408e03-2e17-416b-98a6-a88bcb85dcb0 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:44.793305 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65408e03-2e17-416b-98a6-a88bcb85dcb0 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:44.793671 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65408e03-2e17-416b-98a6-a88bcb85dcb0 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:44.794440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65408e03-2e17-416b-98a6-a88bcb85dcb0 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:44.794872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65408e03-2e17-416b-98a6-a88bcb85dcb0 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:44.987690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-65408e03-2e17-416b-98a6-a88bcb85dcb0 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:44.988257 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-65408e03-2e17-416b-98a6-a88bcb85dcb0 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1513 microversion: 2.1 time: 0.205977 Jul 20 22:51:44.988837 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 287/571] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:44 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:45.259254 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-c2f50161-186d-4324-aa53-1201e0c59ec7 req-ab801775-17fe-4338-b40a-48fc1b8151fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e03f98-910e-4eeb-a14d-e06495d39bc2", "name": "network-vif-deleted", "tag": "0efce0f9-7d60-43a9-959f-b7ebca9cd95d"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:51:45.267951 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c2f50161-186d-4324-aa53-1201e0c59ec7 req-ab801775-17fe-4338-b40a-48fc1b8151fc service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:45.268394 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c2f50161-186d-4324-aa53-1201e0c59ec7 req-ab801775-17fe-4338-b40a-48fc1b8151fc service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:45.279310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-c2f50161-186d-4324-aa53-1201e0c59ec7 req-ab801775-17fe-4338-b40a-48fc1b8151fc service nova] Creating event network-vif-deleted:0efce0f9-7d60-43a9-959f-b7ebca9cd95d for instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 on hv-cinder-79987 Jul 20 22:51:45.284291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-c2f50161-186d-4324-aa53-1201e0c59ec7 req-ab801775-17fe-4338-b40a-48fc1b8151fc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084136 Jul 20 22:51:45.284948 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 285/572] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:51:45.685876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-35146ccf-9f0a-44c3-a0bb-9bfff44483e1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:45.686666 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-35146ccf-9f0a-44c3-a0bb-9bfff44483e1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:45.692584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-35146ccf-9f0a-44c3-a0bb-9bfff44483e1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:45.697696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-35146ccf-9f0a-44c3-a0bb-9bfff44483e1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:45.697696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-35146ccf-9f0a-44c3-a0bb-9bfff44483e1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:45.697696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-35146ccf-9f0a-44c3-a0bb-9bfff44483e1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:45.822830 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-35146ccf-9f0a-44c3-a0bb-9bfff44483e1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:45.830856 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-35146ccf-9f0a-44c3-a0bb-9bfff44483e1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.150374 Jul 20 22:51:45.831444 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 288/573] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:45 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:46.006475 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:46.007173 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:46.013601 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:46.014089 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:46.015407 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:46.015844 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:46.047681 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:46.048157 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:46.048608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lazy-loading 'fault' on Instance uuid f9e03f98-910e-4eeb-a14d-e06495d39bc2 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:51:46.095831 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f237b9adae24d1ca2262d89eb000de4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '650d54a3145d42748ed81457cdd1eb34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:46.103219 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a16fc3e1-ec54-4dd1-9535-535d34a8e58a tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 200 len: 1309 microversion: 2.1 time: 0.101471 Jul 20 22:51:46.103786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 286/574] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:46 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:46.847893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-445ad4f7-0d5d-41f9-b2af-865677a3acc1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:46.848465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-445ad4f7-0d5d-41f9-b2af-865677a3acc1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:46.854996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-445ad4f7-0d5d-41f9-b2af-865677a3acc1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:46.860481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-445ad4f7-0d5d-41f9-b2af-865677a3acc1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:46.860481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-445ad4f7-0d5d-41f9-b2af-865677a3acc1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:46.860481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-445ad4f7-0d5d-41f9-b2af-865677a3acc1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:46.994868 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-445ad4f7-0d5d-41f9-b2af-865677a3acc1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:47.003312 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-445ad4f7-0d5d-41f9-b2af-865677a3acc1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1677 microversion: 2.1 time: 0.159314 Jul 20 22:51:47.003870 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 289/575] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:46 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:47.120433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:47.120989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] [instance: f9e03f98-910e-4eeb-a14d-e06495d39bc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:47.128040 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:47.128483 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:47.129234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:47.129666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:47.142583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] HTTP exception thrown: Instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 could not be found. Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Request method failure captured: Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 HTTP/1.1 Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IZiP0dyGHEYbgtpHoQp-7NK2NWQ-3Wx0x26hK7tPzomJGulhTK4ke3xDlDDs49KBrglRKjAjESFBkVX7U_v_XTnwaEGyP9T1GRq7HdPQle3c4yfNxI9Ri46MYHEFV_vGiZxlQ35vHFjwINzpvtdJreKt_B3woi8WECVpmkVqoAStbo Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 650d54a3145d42748ed81457cdd1eb34 Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1771043022 Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:51:47.144494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_650d54a3145d42748ed81457cdd1eb34", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/650d54a3145d42748ed81457cdd1eb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/650d54a3145d42748ed81457cdd1eb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/650d54a3145d42748ed81457cdd1eb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-VolumesSnapshotTestJSON-1771043022 Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 650d54a3145d42748ed81457cdd1eb34 Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1771043022 Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-VolumesSnapshotTestJSON-1771043022-project Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 1f237b9adae24d1ca2262d89eb000de4 Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-VolumesSnapshotTestJSON-1771043022-project Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 could not be found. Jul 20 22:51:47.145882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'f9e03f98-910e-4eeb-a14d-e06495d39bc2'} Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 could not be found. Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:51:47.146707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 could not be found. Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 could not be found. Jul 20 22:51:47.148044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:51:47.149331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] Returning 404 to user: Instance f9e03f98-910e-4eeb-a14d-e06495d39bc2 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:51:47.149331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-82cd2f19-00a8-49d3-b0a9-ad5641893d75 tempest-VolumesSnapshotTestJSON-1771043022 tempest-VolumesSnapshotTestJSON-1771043022-project] 10.222.0.81 "GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2" status: 404 len: 111 microversion: 2.1 time: 0.029370 Jul 20 22:51:47.149331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 287/576] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:47 2022] GET /compute/v2.1/servers/f9e03f98-910e-4eeb-a14d-e06495d39bc2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:51:48.021287 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-713e3d56-267b-466b-b6fa-7f2edd40944c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:48.021893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-713e3d56-267b-466b-b6fa-7f2edd40944c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:48.028334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-713e3d56-267b-466b-b6fa-7f2edd40944c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:48.028778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-713e3d56-267b-466b-b6fa-7f2edd40944c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:48.030135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-713e3d56-267b-466b-b6fa-7f2edd40944c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:48.030603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-713e3d56-267b-466b-b6fa-7f2edd40944c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:48.162028 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-713e3d56-267b-466b-b6fa-7f2edd40944c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:48.169779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-713e3d56-267b-466b-b6fa-7f2edd40944c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1654 microversion: 2.1 time: 0.152530 Jul 20 22:51:48.170344 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 290/577] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:48 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:48.186592 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0c603f43-6f4e-46c7-8b9f-fde358464dcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:51:48.193337 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0c603f43-6f4e-46c7-8b9f-fde358464dcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:48.195956 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0c603f43-6f4e-46c7-8b9f-fde358464dcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:48.254785 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0c603f43-6f4e-46c7-8b9f-fde358464dcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Going to try to start instance {{(pid=124912) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 22:51:48.544032 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0c603f43-6f4e-46c7-8b9f-fde358464dcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/action" status: 202 len: 0 microversion: 2.1 time: 0.361565 Jul 20 22:51:48.544611 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 288/578] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:51:48 2022] POST /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:51:48.553557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cdb744a7-b4d9-4d4b-9b57-ea3805432cc0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:48.554250 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cdb744a7-b4d9-4d4b-9b57-ea3805432cc0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:48.560295 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cdb744a7-b4d9-4d4b-9b57-ea3805432cc0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:48.560798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cdb744a7-b4d9-4d4b-9b57-ea3805432cc0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:48.562166 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cdb744a7-b4d9-4d4b-9b57-ea3805432cc0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:48.562590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cdb744a7-b4d9-4d4b-9b57-ea3805432cc0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:48.693578 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cdb744a7-b4d9-4d4b-9b57-ea3805432cc0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:48.700976 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cdb744a7-b4d9-4d4b-9b57-ea3805432cc0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1663 microversion: 2.1 time: 0.151330 Jul 20 22:51:48.701541 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 291/579] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:48 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:49.719293 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-00b83d14-b4df-469e-b1c4-168a220bf7f7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:49.719991 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-00b83d14-b4df-469e-b1c4-168a220bf7f7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:49.722029 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:49.726962 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-00b83d14-b4df-469e-b1c4-168a220bf7f7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:49.727442 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-00b83d14-b4df-469e-b1c4-168a220bf7f7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:49.728202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-00b83d14-b4df-469e-b1c4-168a220bf7f7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:49.728638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-00b83d14-b4df-469e-b1c4-168a220bf7f7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:49.860067 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-00b83d14-b4df-469e-b1c4-168a220bf7f7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:49.868002 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-00b83d14-b4df-469e-b1c4-168a220bf7f7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1663 microversion: 2.1 time: 0.153959 Jul 20 22:51:49.868662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 289/580] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:49 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:51:50.884994 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-67cc8c68-bbfc-47f0-814e-370d99eccac0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:51:50.885600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-67cc8c68-bbfc-47f0-814e-370d99eccac0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:51:50.892661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-67cc8c68-bbfc-47f0-814e-370d99eccac0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:50.893111 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-67cc8c68-bbfc-47f0-814e-370d99eccac0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:50.894140 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-67cc8c68-bbfc-47f0-814e-370d99eccac0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:51:50.894575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-67cc8c68-bbfc-47f0-814e-370d99eccac0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:51:51.026271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-67cc8c68-bbfc-47f0-814e-370d99eccac0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:51:51.034696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-67cc8c68-bbfc-47f0-814e-370d99eccac0 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1667 microversion: 2.1 time: 0.153589 Jul 20 22:51:51.035584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 292/581] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:51:50 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:21.385033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:52:21.385568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 22:52:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:52:28.536530 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:28.536530 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:28.908938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-530d8294-0131-445c-98c3-1e7e71d6b23d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:28.909565 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-530d8294-0131-445c-98c3-1e7e71d6b23d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:28.921666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-530d8294-0131-445c-98c3-1e7e71d6b23d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:28.922372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-530d8294-0131-445c-98c3-1e7e71d6b23d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:28.923294 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-530d8294-0131-445c-98c3-1e7e71d6b23d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:28.923799 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-530d8294-0131-445c-98c3-1e7e71d6b23d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:28.958560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-530d8294-0131-445c-98c3-1e7e71d6b23d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe/ips" status: 200 len: 150 microversion: 2.1 time: 0.434991 Jul 20 22:52:28.974848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91cf5fd9-685b-4303-bf10-5a2172a23743"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:28.976562 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:28.980826 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=49 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:28.981486 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 290/582] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:52:28 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe/ips => generated 150 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:28.982881 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:28.986837 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:28.987339 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:28.988454 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:28.989242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:29.098887 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Invalid volume: volume 91cf5fd9-685b-4303-bf10-5a2172a23743 is already attached to instances: b26d2070-596e-440d-8b3b-39be974f5bd3 Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: POST /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe/os-volume_attachments HTTP/1.1 Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 74 Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:52:29.100789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {"volumeAttachment": {"volumeId": "91cf5fd9-685b-4303-bf10-5a2172a23743"}} Jul 20 22:52:29.102398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Invalid volume: volume 91cf5fd9-685b-4303-bf10-5a2172a23743 is already attached to instances: b26d2070-596e-440d-8b3b-39be974f5bd3 Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'server_id': '24366b66-5a54-44ea-95a2-da361e4a3ffe', 'body': {'volumeAttachment': {'volumeId': '91cf5fd9-685b-4303-bf10-5a2172a23743'}}} Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 91cf5fd9-685b-4303-bf10-5a2172a23743 is already attached to instances: b26d2070-596e-440d-8b3b-39be974f5bd3 Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:29.103352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 91cf5fd9-685b-4303-bf10-5a2172a23743 is already attached to instances: b26d2070-596e-440d-8b3b-39be974f5bd3 Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:29.104504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:52:29.106058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:52:29.106058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:52:29.106058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:52:29.106058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 91cf5fd9-685b-4303-bf10-5a2172a23743 is already attached to instances: b26d2070-596e-440d-8b3b-39be974f5bd3 Jul 20 22:52:29.106058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:29.106058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 400 to user: Invalid volume: volume 91cf5fd9-685b-4303-bf10-5a2172a23743 is already attached to instances: b26d2070-596e-440d-8b3b-39be974f5bd3 {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:52:29.107631 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-512a0b8a-0131-434c-95c7-52e0e3445eb6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137552 Jul 20 22:52:29.108342 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 293/583] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:52:28 2022] POST /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe/os-volume_attachments => generated 174 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:52:29.117209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f874c986-9b44-4820-9f05-831b319e64c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:29.117738 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f874c986-9b44-4820-9f05-831b319e64c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:29.126011 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f874c986-9b44-4820-9f05-831b319e64c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:29.126241 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f874c986-9b44-4820-9f05-831b319e64c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:29.127033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f874c986-9b44-4820-9f05-831b319e64c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:29.127464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f874c986-9b44-4820-9f05-831b319e64c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:29.158560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f874c986-9b44-4820-9f05-831b319e64c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:52:29.565853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f874c986-9b44-4820-9f05-831b319e64c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 204 len: 0 microversion: 2.1 time: 0.449897 Jul 20 22:52:29.571616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 291/584] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:52:29 2022] DELETE /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:52:29.576533 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5b64f666-47d7-49b4-bdd0-96f81cf3043b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:29.577158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5b64f666-47d7-49b4-bdd0-96f81cf3043b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:29.587041 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b64f666-47d7-49b4-bdd0-96f81cf3043b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:29.587876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b64f666-47d7-49b4-bdd0-96f81cf3043b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:29.588952 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b64f666-47d7-49b4-bdd0-96f81cf3043b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:29.589791 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b64f666-47d7-49b4-bdd0-96f81cf3043b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:29.807453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5b64f666-47d7-49b4-bdd0-96f81cf3043b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:29.819781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5b64f666-47d7-49b4-bdd0-96f81cf3043b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.247189 Jul 20 22:52:29.821519 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 294/585] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:29 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1683 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:30.838344 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0329a2ff-a2e7-4093-beb2-fd1c67c4f4f7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:30.839087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0329a2ff-a2e7-4093-beb2-fd1c67c4f4f7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:30.846605 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0329a2ff-a2e7-4093-beb2-fd1c67c4f4f7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:30.847084 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0329a2ff-a2e7-4093-beb2-fd1c67c4f4f7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:30.847882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0329a2ff-a2e7-4093-beb2-fd1c67c4f4f7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:30.848339 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0329a2ff-a2e7-4093-beb2-fd1c67c4f4f7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:31.043579 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0329a2ff-a2e7-4093-beb2-fd1c67c4f4f7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:31.051615 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0329a2ff-a2e7-4093-beb2-fd1c67c4f4f7 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.217533 Jul 20 22:52:31.052193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 292/586] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:30 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:32.070277 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-34d3e584-6694-4fcc-b4d9-d961cb4c436c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:32.076511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-34d3e584-6694-4fcc-b4d9-d961cb4c436c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:32.085928 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-34d3e584-6694-4fcc-b4d9-d961cb4c436c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:32.086369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-34d3e584-6694-4fcc-b4d9-d961cb4c436c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:32.087355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-34d3e584-6694-4fcc-b4d9-d961cb4c436c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:32.087966 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-34d3e584-6694-4fcc-b4d9-d961cb4c436c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:32.301810 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-34d3e584-6694-4fcc-b4d9-d961cb4c436c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:32.316271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-34d3e584-6694-4fcc-b4d9-d961cb4c436c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1683 microversion: 2.1 time: 0.250657 Jul 20 22:52:32.322094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 295/587] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:32 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1683 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:32.337239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-376a4aeb-f526-4ffa-899f-856e76da76fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Action: 'create', calling method: .version_select at 0x7fe243f50820>, body: {"keypair": {"name": "tempest-TestShelveInstance-987704683", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSuOR3QWTi5GEXyBrVOKeEweA8RqApmeON1BZEpM51I1zV6rfFyfR7C23J9Odh048g4RLymqgGb7n44d7185kBHyhMmRec/urcqIlpKXDpg/EqhdNV4n/2D4NI1KOEy4A=="}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:32.353510 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-376a4aeb-f526-4ffa-899f-856e76da76fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Getting quotas for project a257ecd598a74a5cb15fc4b62c5a5979. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:52:32.357285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-376a4aeb-f526-4ffa-899f-856e76da76fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Getting quotas for user 3ce4c02d3e314761ba613a802194b709 and project a257ecd598a74a5cb15fc4b62c5a5979. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:52:32.442205 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-376a4aeb-f526-4ffa-899f-856e76da76fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.248890 Jul 20 22:52:32.442808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 293/588] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 22:52:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:52:32.740626 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-a3d45421-431e-4ef9-8316-70050895eeca req-d310266f-bd38-47d1-81c8-ff5bd9dcc73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24366b66-5a54-44ea-95a2-da361e4a3ffe", "name": "network-vif-deleted", "tag": "45626d8c-d54c-4e76-87bd-74a8f515a33c"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:32.750105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-a3d45421-431e-4ef9-8316-70050895eeca req-d310266f-bd38-47d1-81c8-ff5bd9dcc73a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:32.750638 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-a3d45421-431e-4ef9-8316-70050895eeca req-d310266f-bd38-47d1-81c8-ff5bd9dcc73a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:32.770861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-a3d45421-431e-4ef9-8316-70050895eeca req-d310266f-bd38-47d1-81c8-ff5bd9dcc73a service nova] Creating event network-vif-deleted:45626d8c-d54c-4e76-87bd-74a8f515a33c for instance 24366b66-5a54-44ea-95a2-da361e4a3ffe on hv-cinder-79987 Jul 20 22:52:32.776118 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-a3d45421-431e-4ef9-8316-70050895eeca req-d310266f-bd38-47d1-81c8-ff5bd9dcc73a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039145 Jul 20 22:52:32.781838 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 296/589] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:33.339594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:33.340919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:33.373311 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:33.382960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:33.393635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:33.393635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:33.449847 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:33.450543 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:33.454449 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lazy-loading 'fault' on Instance uuid 24366b66-5a54-44ea-95a2-da361e4a3ffe {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:52:33.523617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:33.528725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4fdd9fcd-5d07-4616-956f-b6f47961a3d4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 200 len: 1332 microversion: 2.1 time: 0.195494 Jul 20 22:52:33.529866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 294/590] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:33 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 1332 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:34.547606 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:34.549049 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:34.560577 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:34.561267 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:34.562251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:34.562845 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:34.577185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe HTTP/1.1 Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:52:34.578823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:52:34.587403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '24366b66-5a54-44ea-95a2-da361e4a3ffe'} Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:52:34.588419 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:52:34.590383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:34.591686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:52:34.591686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a290387b-3bf8-42af-bfb4-953b10883cc2 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 404 len: 111 microversion: 2.1 time: 0.038271 Jul 20 22:52:34.591686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 297/591] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:34 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:52:34.591914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0fb6707c-69f1-41b4-9cf1-fb43f761e6e1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '.version_select at 0x7fe243fc7e50>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:34.740751 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0fb6707c-69f1-41b4-9cf1-fb43f761e6e1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044150379" status: 202 len: 0 microversion: 2.1 time: 0.154772 Jul 20 22:52:34.741518 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 295/592] 10.222.0.81 () {58 vars in 1220 bytes} [Wed Jul 20 22:52:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1044150379 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 22:52:35.870843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fd1b77e0-a5c5-4ff6-bea8-25214b333021 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:35.871367 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fd1b77e0-a5c5-4ff6-bea8-25214b333021 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:35.888188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fd1b77e0-a5c5-4ff6-bea8-25214b333021 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:35.888188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fd1b77e0-a5c5-4ff6-bea8-25214b333021 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:35.888188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fd1b77e0-a5c5-4ff6-bea8-25214b333021 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:35.888188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fd1b77e0-a5c5-4ff6-bea8-25214b333021 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:35.999415 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-fd1b77e0-a5c5-4ff6-bea8-25214b333021 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lazy-loading 'services' on Instance uuid b26d2070-596e-440d-8b3b-39be974f5bd3 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:52:36.228885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fd1b77e0-a5c5-4ff6-bea8-25214b333021 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments/91cf5fd9-685b-4303-bf10-5a2172a23743" status: 202 len: 0 microversion: 2.1 time: 0.361885 Jul 20 22:52:36.229487 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 298/593] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:52:35 2022] DELETE /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments/91cf5fd9-685b-4303-bf10-5a2172a23743 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:52:36.238328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ff135036-8102-4af8-b41c-b5a8747c546a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:36.243381 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ff135036-8102-4af8-b41c-b5a8747c546a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:36.250474 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ff135036-8102-4af8-b41c-b5a8747c546a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:36.255302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ff135036-8102-4af8-b41c-b5a8747c546a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:36.255302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ff135036-8102-4af8-b41c-b5a8747c546a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:36.255302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ff135036-8102-4af8-b41c-b5a8747c546a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:36.283897 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ff135036-8102-4af8-b41c-b5a8747c546a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049957 Jul 20 22:52:36.284439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 296/594] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:52:36 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:37.296421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6be82edc-eff4-4709-b853-b2c15b3151ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:37.297587 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6be82edc-eff4-4709-b853-b2c15b3151ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:37.304704 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6be82edc-eff4-4709-b853-b2c15b3151ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:37.305365 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6be82edc-eff4-4709-b853-b2c15b3151ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:37.306331 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6be82edc-eff4-4709-b853-b2c15b3151ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:37.306839 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6be82edc-eff4-4709-b853-b2c15b3151ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:37.340388 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6be82edc-eff4-4709-b853-b2c15b3151ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048446 Jul 20 22:52:37.340914 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 299/595] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:52:37 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:38.351887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9cd85baf-5b50-423d-9b19-909831483f03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:38.352834 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9cd85baf-5b50-423d-9b19-909831483f03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:38.360151 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9cd85baf-5b50-423d-9b19-909831483f03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:38.360601 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9cd85baf-5b50-423d-9b19-909831483f03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:38.361383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9cd85baf-5b50-423d-9b19-909831483f03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:38.361819 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9cd85baf-5b50-423d-9b19-909831483f03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:38.393869 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9cd85baf-5b50-423d-9b19-909831483f03 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045783 Jul 20 22:52:38.394441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 297/596] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:52:38 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:52:38.451453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e3ace88f-f555-4af1-9922-79503f3596ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:38.451949 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e3ace88f-f555-4af1-9922-79503f3596ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:38.458338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3ace88f-f555-4af1-9922-79503f3596ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:38.458786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3ace88f-f555-4af1-9922-79503f3596ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:38.459580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3ace88f-f555-4af1-9922-79503f3596ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:38.460017 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3ace88f-f555-4af1-9922-79503f3596ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:38.485333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e3ace88f-f555-4af1-9922-79503f3596ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:52:38.754242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e3ace88f-f555-4af1-9922-79503f3596ef tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 204 len: 0 microversion: 2.1 time: 0.306909 Jul 20 22:52:38.754749 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 300/597] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:52:38 2022] DELETE /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:52:38.762925 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6289f8ed-fe11-41fa-bf7c-33d211407188 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:38.763595 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6289f8ed-fe11-41fa-bf7c-33d211407188 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:38.769962 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6289f8ed-fe11-41fa-bf7c-33d211407188 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:38.770403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6289f8ed-fe11-41fa-bf7c-33d211407188 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:38.771180 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6289f8ed-fe11-41fa-bf7c-33d211407188 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:38.771610 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6289f8ed-fe11-41fa-bf7c-33d211407188 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:38.907913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6289f8ed-fe11-41fa-bf7c-33d211407188 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:38.915566 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6289f8ed-fe11-41fa-bf7c-33d211407188 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1680 microversion: 2.1 time: 0.156404 Jul 20 22:52:38.916136 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 298/598] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:38 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:39.934201 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-bef68a48-8f8f-46df-8cf8-f76bbd1f5035 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:39.934876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-bef68a48-8f8f-46df-8cf8-f76bbd1f5035 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:39.942447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bef68a48-8f8f-46df-8cf8-f76bbd1f5035 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:39.942791 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bef68a48-8f8f-46df-8cf8-f76bbd1f5035 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:39.943590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bef68a48-8f8f-46df-8cf8-f76bbd1f5035 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:39.944162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bef68a48-8f8f-46df-8cf8-f76bbd1f5035 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:40.075258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-bef68a48-8f8f-46df-8cf8-f76bbd1f5035 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:40.082618 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-bef68a48-8f8f-46df-8cf8-f76bbd1f5035 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1680 microversion: 2.1 time: 0.152669 Jul 20 22:52:40.083215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 301/599] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:39 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:41.064654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-0d888e9e-2ff9-4021-b163-1cea1245ca12 req-45b3f157-94b6-4f68-ac70-b9ded851c24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b26d2070-596e-440d-8b3b-39be974f5bd3", "name": "network-vif-deleted", "tag": "3ef07cb8-939b-46e3-b2ca-eedb58f07b4a"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:41.077483 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-0d888e9e-2ff9-4021-b163-1cea1245ca12 req-45b3f157-94b6-4f68-ac70-b9ded851c24c service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:41.077483 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-0d888e9e-2ff9-4021-b163-1cea1245ca12 req-45b3f157-94b6-4f68-ac70-b9ded851c24c service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:41.092802 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-0d888e9e-2ff9-4021-b163-1cea1245ca12 req-45b3f157-94b6-4f68-ac70-b9ded851c24c service nova] Creating event network-vif-deleted:3ef07cb8-939b-46e3-b2ca-eedb58f07b4a for instance b26d2070-596e-440d-8b3b-39be974f5bd3 on hv-cinder-79987 Jul 20 22:52:41.099185 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-0d888e9e-2ff9-4021-b163-1cea1245ca12 req-45b3f157-94b6-4f68-ac70-b9ded851c24c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039547 Jul 20 22:52:41.099943 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 299/600] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:41.106142 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3df41e1c-72fb-480a-aea3-355d9c0291ac tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:41.106142 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3df41e1c-72fb-480a-aea3-355d9c0291ac tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:41.108803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3df41e1c-72fb-480a-aea3-355d9c0291ac tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:41.109262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3df41e1c-72fb-480a-aea3-355d9c0291ac tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:41.110028 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3df41e1c-72fb-480a-aea3-355d9c0291ac tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:41.110462 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3df41e1c-72fb-480a-aea3-355d9c0291ac tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:41.187143 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3df41e1c-72fb-480a-aea3-355d9c0291ac tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:41.202284 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3df41e1c-72fb-480a-aea3-355d9c0291ac tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1612 microversion: 2.1 time: 0.105540 Jul 20 22:52:41.202884 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 302/601] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:41 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1612 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:52:42.222478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:42.223247 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:42.230756 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:42.231323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:42.232087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:42.232577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:42.265348 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:42.265786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:42.266479 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lazy-loading 'fault' on Instance uuid b26d2070-596e-440d-8b3b-39be974f5bd3 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:52:42.307995 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:42.315144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-61fdf184-e072-48e9-b43a-97de95de1fff tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 200 len: 1331 microversion: 2.1 time: 0.098508 Jul 20 22:52:42.315721 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 300/602] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:42 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:43.332784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:43.333379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:43.340571 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:43.341011 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:43.341778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:43.342204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:43.357560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 HTTP/1.1 Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:52:43.359263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:52:43.360885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'b26d2070-596e-440d-8b3b-39be974f5bd3'} Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:52:43.361963 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:52:43.363485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:52:43.364948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:52:43.364948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2074e3a8-e1a4-430f-b1f3-00d27173fc4f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 404 len: 111 microversion: 2.1 time: 0.031661 Jul 20 22:52:43.364948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 303/603] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:43 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:52:43.370155 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1c67c930-fe09-47f1-a855-b21de8c4d782 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '.version_select at 0x7fe243ee29d0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:43.375912 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=4 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:43.434752 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1c67c930-fe09-47f1-a855-b21de8c4d782 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442648441" status: 202 len: 0 microversion: 2.1 time: 0.068562 Jul 20 22:52:43.435338 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 301/604] 10.222.0.81 () {58 vars in 1220 bytes} [Wed Jul 20 22:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442648441 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:52:44.234239 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0b313ce7-b326-4f8e-8485-7d8fc9b447d8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: .version_select at 0x7fe243d950d0>, body: {"keypair": {"name": "tempest-keypair-76324580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfuBo896lk/qtxVzs/BaswoZv2YfqfgPnVTUdKp5hIvDMXsBWFox06OlykNcV1CSsrJr9ARSOsNRuM7ypmCBJTwCZEvzQ8yxC8G7oRMfOmFNs1NNmU769rWu88NF/nVxg=="}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:44.248327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-0b313ce7-b326-4f8e-8485-7d8fc9b447d8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for project f733781536584f80acfc325bf8444536. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:52:44.252342 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-0b313ce7-b326-4f8e-8485-7d8fc9b447d8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for user 3e072e59bf3e46aaa062ec85b0e2c91a and project f733781536584f80acfc325bf8444536. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:52:44.338696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0b313ce7-b326-4f8e-8485-7d8fc9b447d8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.108742 Jul 20 22:52:44.339852 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 304/605] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 22:52:44 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:52:46.308363 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-51e15466-a9aa-4ef1-ac72-69057ea1df3f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:46.308869 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-51e15466-a9aa-4ef1-ac72-69057ea1df3f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:46.314763 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-51e15466-a9aa-4ef1-ac72-69057ea1df3f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:46.315234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-51e15466-a9aa-4ef1-ac72-69057ea1df3f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:46.316012 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-51e15466-a9aa-4ef1-ac72-69057ea1df3f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:46.316436 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-51e15466-a9aa-4ef1-ac72-69057ea1df3f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:46.395210 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-51e15466-a9aa-4ef1-ac72-69057ea1df3f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lazy-loading 'services' on Instance uuid 87967be5-1f31-4e6c-afe0-f3c63923c558 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:52:46.691942 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-114758723", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b157aec-dd9e-48b2-9003-4eeafc1a43e4"}], "security_groups": [{"name": "tempest-securitygroup--792671725"}], "key_name": "tempest-keypair-76324580", "user_data": "}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:46.705985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-51e15466-a9aa-4ef1-ac72-69057ea1df3f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments/37dc87b6-46ba-4422-8f33-14e3c2e74060" status: 202 len: 0 microversion: 2.1 time: 0.402243 Jul 20 22:52:46.708392 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 302/606] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:52:46 2022] DELETE /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments/37dc87b6-46ba-4422-8f33-14e3c2e74060 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:52:46.728533 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a1a897f3-31f2-4082-bc01-50539086f5aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:46.730853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a1a897f3-31f2-4082-bc01-50539086f5aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:46.741968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a1a897f3-31f2-4082-bc01-50539086f5aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:46.741968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a1a897f3-31f2-4082-bc01-50539086f5aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:46.741968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a1a897f3-31f2-4082-bc01-50539086f5aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:46.741968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a1a897f3-31f2-4082-bc01-50539086f5aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:46.774064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a1a897f3-31f2-4082-bc01-50539086f5aa tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Jul 20 22:52:46.774929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 303/607] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:52:46 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:46.802151 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] validate_networks() for [('6b157aec-dd9e-48b2-9003-4eeafc1a43e4', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:52:47.178731 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:52:47.179194 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:52:47.179669 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:52:47.180083 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:52:47.180521 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:52:47.189341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:47.189786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:47.190570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:47.191020 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:47.207133 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for project f733781536584f80acfc325bf8444536. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:52:47.210989 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for user 3e072e59bf3e46aaa062ec85b0e2c91a and project f733781536584f80acfc325bf8444536. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:52:47.222057 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:52:47.224328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:52:47.403171 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d7aa1c15-443a-4b91-83fa-485cc5686432 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.716009 Jul 20 22:52:47.403984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 305/608] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:52:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 22:52:47.416112 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-97e42f9e-9392-4147-9a45-cf4c03d1bf41 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:47.416675 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-97e42f9e-9392-4147-9a45-cf4c03d1bf41 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:47.474825 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-97e42f9e-9392-4147-9a45-cf4c03d1bf41 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:47.481904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-97e42f9e-9392-4147-9a45-cf4c03d1bf41 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1239 microversion: 2.1 time: 0.071739 Jul 20 22:52:47.486423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 304/609] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:47 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:52:47.786500 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-91e9a502-0b03-40a9-bd08-d3128340af9a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:47.788203 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-91e9a502-0b03-40a9-bd08-d3128340af9a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:47.794973 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91e9a502-0b03-40a9-bd08-d3128340af9a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:47.795441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91e9a502-0b03-40a9-bd08-d3128340af9a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:47.796210 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91e9a502-0b03-40a9-bd08-d3128340af9a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:47.796643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91e9a502-0b03-40a9-bd08-d3128340af9a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:47.832162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-91e9a502-0b03-40a9-bd08-d3128340af9a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Jul 20 22:52:47.832162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 306/610] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:52:47 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:48.498922 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e02e1759-7918-450d-9659-fe78f1daa8b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:48.499546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e02e1759-7918-450d-9659-fe78f1daa8b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:48.506555 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e02e1759-7918-450d-9659-fe78f1daa8b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:48.507133 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e02e1759-7918-450d-9659-fe78f1daa8b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:48.507770 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e02e1759-7918-450d-9659-fe78f1daa8b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:48.508211 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e02e1759-7918-450d-9659-fe78f1daa8b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:48.568718 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e02e1759-7918-450d-9659-fe78f1daa8b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:48.576160 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e02e1759-7918-450d-9659-fe78f1daa8b8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1243 microversion: 2.1 time: 0.081641 Jul 20 22:52:48.576730 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 305/611] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:48 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1243 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:48.839894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-90c29abe-0b5a-4eac-973b-ca16f075101a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:48.840861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-90c29abe-0b5a-4eac-973b-ca16f075101a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:48.847422 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-90c29abe-0b5a-4eac-973b-ca16f075101a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:48.847872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-90c29abe-0b5a-4eac-973b-ca16f075101a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:48.848672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-90c29abe-0b5a-4eac-973b-ca16f075101a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:48.849108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-90c29abe-0b5a-4eac-973b-ca16f075101a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:48.878413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-90c29abe-0b5a-4eac-973b-ca16f075101a tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042966 Jul 20 22:52:48.878969 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 307/612] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:52:48 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:52:48.954331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-37d49cbe-a2be-4a97-b67e-ba139b6e585f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:48.954824 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-37d49cbe-a2be-4a97-b67e-ba139b6e585f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:48.960973 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-37d49cbe-a2be-4a97-b67e-ba139b6e585f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:48.961421 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-37d49cbe-a2be-4a97-b67e-ba139b6e585f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:48.962173 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-37d49cbe-a2be-4a97-b67e-ba139b6e585f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:48.962605 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-37d49cbe-a2be-4a97-b67e-ba139b6e585f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:48.987331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-37d49cbe-a2be-4a97-b67e-ba139b6e585f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:52:49.085324 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:49.257989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-37d49cbe-a2be-4a97-b67e-ba139b6e585f tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 204 len: 0 microversion: 2.1 time: 0.307225 Jul 20 22:52:49.258578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 306/613] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:52:48 2022] DELETE /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:52:49.267409 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9f54d069-95af-4df8-ba3d-17a47d3bf288 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:49.269235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9f54d069-95af-4df8-ba3d-17a47d3bf288 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:49.273877 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9f54d069-95af-4df8-ba3d-17a47d3bf288 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:49.274323 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9f54d069-95af-4df8-ba3d-17a47d3bf288 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:49.275110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9f54d069-95af-4df8-ba3d-17a47d3bf288 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:49.275542 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9f54d069-95af-4df8-ba3d-17a47d3bf288 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:49.407641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9f54d069-95af-4df8-ba3d-17a47d3bf288 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:49.415848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9f54d069-95af-4df8-ba3d-17a47d3bf288 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1690 microversion: 2.1 time: 0.152431 Jul 20 22:52:49.416467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 308/614] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:49 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:49.593296 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5ac42cec-44b5-45e4-b844-eab156a7e3c0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:49.593999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-5ac42cec-44b5-45e4-b844-eab156a7e3c0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:49.600647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5ac42cec-44b5-45e4-b844-eab156a7e3c0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:49.601082 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5ac42cec-44b5-45e4-b844-eab156a7e3c0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:49.601835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5ac42cec-44b5-45e4-b844-eab156a7e3c0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:49.602295 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5ac42cec-44b5-45e4-b844-eab156a7e3c0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:49.664117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-5ac42cec-44b5-45e4-b844-eab156a7e3c0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:49.672050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5ac42cec-44b5-45e4-b844-eab156a7e3c0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1299 microversion: 2.1 time: 0.082961 Jul 20 22:52:49.672602 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 307/615] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:49 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:50.433309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-671ce9ac-0292-49a0-9c6a-7e38f5ecda89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:50.436843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-671ce9ac-0292-49a0-9c6a-7e38f5ecda89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:50.443657 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-671ce9ac-0292-49a0-9c6a-7e38f5ecda89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:50.444110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-671ce9ac-0292-49a0-9c6a-7e38f5ecda89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:50.444885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-671ce9ac-0292-49a0-9c6a-7e38f5ecda89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:50.445322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-671ce9ac-0292-49a0-9c6a-7e38f5ecda89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:50.576205 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-671ce9ac-0292-49a0-9c6a-7e38f5ecda89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:50.583567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-671ce9ac-0292-49a0-9c6a-7e38f5ecda89 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1690 microversion: 2.1 time: 0.154394 Jul 20 22:52:50.584158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 309/616] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:50 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:50.688713 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-793514b2-79a8-4e39-b9c0-242010f1cf6c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:50.689323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-793514b2-79a8-4e39-b9c0-242010f1cf6c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:50.695880 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-793514b2-79a8-4e39-b9c0-242010f1cf6c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:50.696327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-793514b2-79a8-4e39-b9c0-242010f1cf6c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:50.697085 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-793514b2-79a8-4e39-b9c0-242010f1cf6c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:50.697522 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-793514b2-79a8-4e39-b9c0-242010f1cf6c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:50.763744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-793514b2-79a8-4e39-b9c0-242010f1cf6c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:50.771865 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-793514b2-79a8-4e39-b9c0-242010f1cf6c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1299 microversion: 2.1 time: 0.086968 Jul 20 22:52:50.772497 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 308/617] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:50 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:51.601134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-bd31debb-373b-4da8-8682-06909450d095 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:51.601775 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-bd31debb-373b-4da8-8682-06909450d095 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:51.608802 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bd31debb-373b-4da8-8682-06909450d095 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:51.609256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bd31debb-373b-4da8-8682-06909450d095 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:51.610014 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bd31debb-373b-4da8-8682-06909450d095 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:51.610448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bd31debb-373b-4da8-8682-06909450d095 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:51.736451 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-bd31debb-373b-4da8-8682-06909450d095 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:51.739960 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:51.744354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-bd31debb-373b-4da8-8682-06909450d095 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1690 microversion: 2.1 time: 0.147046 Jul 20 22:52:51.750004 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 310/618] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:51 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:51.788379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-836f4c27-db3d-41d7-b476-96d9b404bcd0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:51.788984 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-836f4c27-db3d-41d7-b476-96d9b404bcd0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:51.796242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-836f4c27-db3d-41d7-b476-96d9b404bcd0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:51.796680 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-836f4c27-db3d-41d7-b476-96d9b404bcd0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:51.797430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-836f4c27-db3d-41d7-b476-96d9b404bcd0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:51.797856 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-836f4c27-db3d-41d7-b476-96d9b404bcd0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:51.857806 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-836f4c27-db3d-41d7-b476-96d9b404bcd0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:51.865063 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-836f4c27-db3d-41d7-b476-96d9b404bcd0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1299 microversion: 2.1 time: 0.080444 Jul 20 22:52:51.865616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 309/619] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:51 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:52.761336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5f26bd66-6d96-4a15-86fb-08f3b74ded97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:52.763666 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5f26bd66-6d96-4a15-86fb-08f3b74ded97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:52.769445 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5f26bd66-6d96-4a15-86fb-08f3b74ded97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:52.769901 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5f26bd66-6d96-4a15-86fb-08f3b74ded97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:52.770670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5f26bd66-6d96-4a15-86fb-08f3b74ded97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:52.771134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5f26bd66-6d96-4a15-86fb-08f3b74ded97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:52.881659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f5268587-2d41-42b8-8902-7239c695c03b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:52.882251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f5268587-2d41-42b8-8902-7239c695c03b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:52.888787 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f5268587-2d41-42b8-8902-7239c695c03b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:52.889326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f5268587-2d41-42b8-8902-7239c695c03b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:52.890076 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f5268587-2d41-42b8-8902-7239c695c03b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:52.890504 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f5268587-2d41-42b8-8902-7239c695c03b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:52.903861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5f26bd66-6d96-4a15-86fb-08f3b74ded97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:52.911238 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5f26bd66-6d96-4a15-86fb-08f3b74ded97 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1690 microversion: 2.1 time: 0.153760 Jul 20 22:52:52.911805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 311/620] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:52 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:52.983239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f5268587-2d41-42b8-8902-7239c695c03b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:52.990994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f5268587-2d41-42b8-8902-7239c695c03b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1309 microversion: 2.1 time: 0.113047 Jul 20 22:52:52.991759 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 310/621] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:52 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:52:53.929201 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0ab5546a-5be4-4403-bd54-36a2aff21d8d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:53.929796 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0ab5546a-5be4-4403-bd54-36a2aff21d8d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:53.937134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0ab5546a-5be4-4403-bd54-36a2aff21d8d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:53.937480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0ab5546a-5be4-4403-bd54-36a2aff21d8d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:53.938472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0ab5546a-5be4-4403-bd54-36a2aff21d8d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:53.939124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0ab5546a-5be4-4403-bd54-36a2aff21d8d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:54.016891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-35cf86da-4370-4cf4-bc07-28a0971c896a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:54.017526 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-35cf86da-4370-4cf4-bc07-28a0971c896a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:54.030515 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-35cf86da-4370-4cf4-bc07-28a0971c896a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:54.031157 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-35cf86da-4370-4cf4-bc07-28a0971c896a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:54.032188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-35cf86da-4370-4cf4-bc07-28a0971c896a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:54.032616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-35cf86da-4370-4cf4-bc07-28a0971c896a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:54.188137 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0ab5546a-5be4-4403-bd54-36a2aff21d8d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:54.201079 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0ab5546a-5be4-4403-bd54-36a2aff21d8d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1690 microversion: 2.1 time: 0.275240 Jul 20 22:52:54.203581 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 312/622] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:53 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1690 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:54.241498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-35cf86da-4370-4cf4-bc07-28a0971c896a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:54.248805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-35cf86da-4370-4cf4-bc07-28a0971c896a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.240948 Jul 20 22:52:54.249468 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 311/623] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:54 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:54.927947 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-6606ca04-1b31-4e3a-ab98-c8b052da7208 req-e71ad22a-f17d-4148-b8d5-1f03ea232b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87967be5-1f31-4e6c-afe0-f3c63923c558", "name": "network-vif-deleted", "tag": "6cedd83c-eef6-4869-997c-997862003129"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:54.928957 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-b816ace6-57ca-4dc8-b19e-cdcd68146752 req-8d83fc75-931f-4a08-9870-84ff6ab3b392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed223901-02ac-40e4-a5df-9d4a3dedc2d2", "tag": "806d0645-f98f-443f-8a84-c9eb87d740ca"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:54.947696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-b816ace6-57ca-4dc8-b19e-cdcd68146752 req-8d83fc75-931f-4a08-9870-84ff6ab3b392 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:54.948178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-6606ca04-1b31-4e3a-ab98-c8b052da7208 req-e71ad22a-f17d-4148-b8d5-1f03ea232b85 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:54.948624 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-6606ca04-1b31-4e3a-ab98-c8b052da7208 req-e71ad22a-f17d-4148-b8d5-1f03ea232b85 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:54.949234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-b816ace6-57ca-4dc8-b19e-cdcd68146752 req-8d83fc75-931f-4a08-9870-84ff6ab3b392 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:54.960992 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-b816ace6-57ca-4dc8-b19e-cdcd68146752 req-8d83fc75-931f-4a08-9870-84ff6ab3b392 service nova] Creating event network-changed:806d0645-f98f-443f-8a84-c9eb87d740ca for instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 on hv-cinder-79987 Jul 20 22:52:54.963584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-6606ca04-1b31-4e3a-ab98-c8b052da7208 req-e71ad22a-f17d-4148-b8d5-1f03ea232b85 service nova] Creating event network-vif-deleted:6cedd83c-eef6-4869-997c-997862003129 for instance 87967be5-1f31-4e6c-afe0-f3c63923c558 on hv-cinder-79987 Jul 20 22:52:54.966587 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-b816ace6-57ca-4dc8-b19e-cdcd68146752 req-8d83fc75-931f-4a08-9870-84ff6ab3b392 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043143 Jul 20 22:52:54.967662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 312/624] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:54.970106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-6606ca04-1b31-4e3a-ab98-c8b052da7208 req-e71ad22a-f17d-4148-b8d5-1f03ea232b85 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050963 Jul 20 22:52:54.971634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 313/625] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:52:55.218949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a723a676-37dd-46b1-9502-c3c4d4c9ba86 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:55.220046 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a723a676-37dd-46b1-9502-c3c4d4c9ba86 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:55.236567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a723a676-37dd-46b1-9502-c3c4d4c9ba86 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:55.237581 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a723a676-37dd-46b1-9502-c3c4d4c9ba86 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:55.238398 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a723a676-37dd-46b1-9502-c3c4d4c9ba86 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:55.238803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a723a676-37dd-46b1-9502-c3c4d4c9ba86 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:55.267819 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-156572d5-82a1-42b6-bb71-81924e21d423 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:55.269239 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-156572d5-82a1-42b6-bb71-81924e21d423 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:55.276705 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-156572d5-82a1-42b6-bb71-81924e21d423 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:55.277387 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-156572d5-82a1-42b6-bb71-81924e21d423 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:55.278185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-156572d5-82a1-42b6-bb71-81924e21d423 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:55.278808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-156572d5-82a1-42b6-bb71-81924e21d423 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:55.341753 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a723a676-37dd-46b1-9502-c3c4d4c9ba86 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:55.351703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a723a676-37dd-46b1-9502-c3c4d4c9ba86 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 200 len: 1331 microversion: 2.1 time: 0.137054 Jul 20 22:52:55.364113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 313/626] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:55 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 1331 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:55.484225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-156572d5-82a1-42b6-bb71-81924e21d423 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:55.492846 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-156572d5-82a1-42b6-bb71-81924e21d423 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.230427 Jul 20 22:52:55.494106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 314/627] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:55 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:56.369289 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:56.369900 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: 87967be5-1f31-4e6c-afe0-f3c63923c558] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:56.376442 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:56.376890 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:56.377658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:56.378094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:56.391778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] HTTP exception thrown: Instance 87967be5-1f31-4e6c-afe0-f3c63923c558 could not be found. Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Request method failure captured: Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 HTTP/1.1 Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWQRNS5QEz_nIx7JpWo3eYPJN2oyFpU7Oa8tzB_exObv7ffo-e51nONWbNwbw_pURsJUKw8Q9iXUPR0igSGfrFxGoD4dwenCxyjEfmDfXIFNCANufGETvsNlinmX78kKFdqLWyz0d4rSgkr5GWAaNPLzpYmmxW3UJtAqqDUqn7ZiCE Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:52:56.393382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_55c688e93c2b414ca86a3c2f9ec84798", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 1ed9249b2a9b42d9972ed71c04f2c888 Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 87967be5-1f31-4e6c-afe0-f3c63923c558 could not be found. Jul 20 22:52:56.394879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '87967be5-1f31-4e6c-afe0-f3c63923c558'} Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87967be5-1f31-4e6c-afe0-f3c63923c558 could not be found. Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:52:56.395978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87967be5-1f31-4e6c-afe0-f3c63923c558 could not be found. Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87967be5-1f31-4e6c-afe0-f3c63923c558 could not be found. Jul 20 22:52:56.397364 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:52:56.398711 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Returning 404 to user: Instance 87967be5-1f31-4e6c-afe0-f3c63923c558 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:52:56.398711 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f9e6ee0c-a523-4cb7-ac7a-007436e4a777 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558" status: 404 len: 111 microversion: 2.1 time: 0.029354 Jul 20 22:52:56.398711 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 314/628] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:56 2022] GET /compute/v2.1/servers/87967be5-1f31-4e6c-afe0-f3c63923c558 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:52:56.403808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-dc1c21e2-f770-42c0-a9bd-4c2797d89408 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '.version_select at 0x7fe243dcd0d0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:56.486289 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-dc1c21e2-f770-42c0-a9bd-4c2797d89408 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332304509" status: 202 len: 0 microversion: 2.1 time: 0.086831 Jul 20 22:52:56.486900 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 315/629] 10.222.0.81 () {58 vars in 1220 bytes} [Wed Jul 20 22:52:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332304509 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:52:56.510956 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fca6ecf4-7f5b-42d0-8538-417dcde111e8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:56.511594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fca6ecf4-7f5b-42d0-8538-417dcde111e8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:56.517885 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fca6ecf4-7f5b-42d0-8538-417dcde111e8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:56.518343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fca6ecf4-7f5b-42d0-8538-417dcde111e8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:56.519135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fca6ecf4-7f5b-42d0-8538-417dcde111e8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:56.519707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fca6ecf4-7f5b-42d0-8538-417dcde111e8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:56.650054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fca6ecf4-7f5b-42d0-8538-417dcde111e8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:56.658214 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fca6ecf4-7f5b-42d0-8538-417dcde111e8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.151712 Jul 20 22:52:56.658773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 315/630] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:56 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:57.036824 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1a0048ea-4f0d-44cd-b44d-ca2bae4ef7e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:57.037872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1a0048ea-4f0d-44cd-b44d-ca2bae4ef7e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:57.045486 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a0048ea-4f0d-44cd-b44d-ca2bae4ef7e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:57.045952 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a0048ea-4f0d-44cd-b44d-ca2bae4ef7e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:57.046708 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a0048ea-4f0d-44cd-b44d-ca2bae4ef7e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:57.047171 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a0048ea-4f0d-44cd-b44d-ca2bae4ef7e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:57.076732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1a0048ea-4f0d-44cd-b44d-ca2bae4ef7e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044100 Jul 20 22:52:57.077292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 316/631] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:52:57 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:52:57.134404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1d446f85-09c4-40f7-abc6-7dbe1da2a2ec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:57.134892 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1d446f85-09c4-40f7-abc6-7dbe1da2a2ec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:57.142352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1d446f85-09c4-40f7-abc6-7dbe1da2a2ec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:57.142352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1d446f85-09c4-40f7-abc6-7dbe1da2a2ec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:57.143145 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1d446f85-09c4-40f7-abc6-7dbe1da2a2ec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:57.143920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1d446f85-09c4-40f7-abc6-7dbe1da2a2ec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:57.169162 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1d446f85-09c4-40f7-abc6-7dbe1da2a2ec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:52:57.399588 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1d446f85-09c4-40f7-abc6-7dbe1da2a2ec tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 204 len: 0 microversion: 2.1 time: 0.268680 Jul 20 22:52:57.400212 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 316/632] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:52:57 2022] DELETE /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:52:57.412861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-df464ef9-d50b-4b53-9cd6-23a8943e6666 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:57.413472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-df464ef9-d50b-4b53-9cd6-23a8943e6666 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:57.415441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:57.416117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=10 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:57.421891 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-df464ef9-d50b-4b53-9cd6-23a8943e6666 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:57.422285 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-df464ef9-d50b-4b53-9cd6-23a8943e6666 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:57.423070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-df464ef9-d50b-4b53-9cd6-23a8943e6666 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:57.423509 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-df464ef9-d50b-4b53-9cd6-23a8943e6666 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:57.554838 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-df464ef9-d50b-4b53-9cd6-23a8943e6666 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:57.562293 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-df464ef9-d50b-4b53-9cd6-23a8943e6666 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1673 microversion: 2.1 time: 0.153301 Jul 20 22:52:57.562852 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 317/633] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:57 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:52:57.674959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8d15c3f0-3988-45fa-a736-87351a965c8b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:57.675548 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8d15c3f0-3988-45fa-a736-87351a965c8b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:57.677468 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:57.682317 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d15c3f0-3988-45fa-a736-87351a965c8b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:57.682762 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d15c3f0-3988-45fa-a736-87351a965c8b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:57.683558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d15c3f0-3988-45fa-a736-87351a965c8b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:57.683994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8d15c3f0-3988-45fa-a736-87351a965c8b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:57.817798 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8d15c3f0-3988-45fa-a736-87351a965c8b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:57.825400 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8d15c3f0-3988-45fa-a736-87351a965c8b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.154775 Jul 20 22:52:57.825961 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 317/634] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:57 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:58.578783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-be962a17-a501-4fa0-95f8-d973430c3094 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:58.579421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-be962a17-a501-4fa0-95f8-d973430c3094 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:58.585866 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be962a17-a501-4fa0-95f8-d973430c3094 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:58.586314 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be962a17-a501-4fa0-95f8-d973430c3094 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:58.587098 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be962a17-a501-4fa0-95f8-d973430c3094 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:58.587536 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be962a17-a501-4fa0-95f8-d973430c3094 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:58.727362 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-be962a17-a501-4fa0-95f8-d973430c3094 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:58.734839 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-be962a17-a501-4fa0-95f8-d973430c3094 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1673 microversion: 2.1 time: 0.159964 Jul 20 22:52:58.735435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 318/635] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:58 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:58.842238 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-db090b4d-a500-4358-8b35-d82edb3b2f8f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:58.842846 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-db090b4d-a500-4358-8b35-d82edb3b2f8f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:58.845181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:58.849868 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-db090b4d-a500-4358-8b35-d82edb3b2f8f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:58.850315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-db090b4d-a500-4358-8b35-d82edb3b2f8f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:58.851096 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-db090b4d-a500-4358-8b35-d82edb3b2f8f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:58.851537 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-db090b4d-a500-4358-8b35-d82edb3b2f8f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:58.981125 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-db090b4d-a500-4358-8b35-d82edb3b2f8f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:52:58.988408 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-db090b4d-a500-4358-8b35-d82edb3b2f8f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.150647 Jul 20 22:52:58.988969 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 318/636] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:58 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:52:59.695447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-480c8519-79d4-48b3-b413-07c79bff57f7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:59.696013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-480c8519-79d4-48b3-b413-07c79bff57f7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:59.698378 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:59.703366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-480c8519-79d4-48b3-b413-07c79bff57f7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:59.703877 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-480c8519-79d4-48b3-b413-07c79bff57f7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:59.704700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-480c8519-79d4-48b3-b413-07c79bff57f7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:59.705241 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-480c8519-79d4-48b3-b413-07c79bff57f7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:59.719246 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1887060485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-987704683", "security_groups": [{"name": "tempest-secgroup-smoke-1335290259"}], "networks": [{"uuid": "adc6c730-f7c9-41b5-b23c-da9b7b402e16"}], "block_device_mapping_v2": [{"uuid": "421cdc51-c6b2-48ac-bdbf-716222acde6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:52:59.731426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-480c8519-79d4-48b3-b413-07c79bff57f7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:52:59.833813 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] validate_networks() for [('adc6c730-f7c9-41b5-b23c-da9b7b402e16', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:52:59.948183 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-480c8519-79d4-48b3-b413-07c79bff57f7 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 204 len: 0 microversion: 2.1 time: 0.256193 Jul 20 22:52:59.948770 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 319/637] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:52:59 2022] DELETE /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:52:59.953803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b6814260-5044-402a-881b-8cf7a53af744 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:52:59.954477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b6814260-5044-402a-881b-8cf7a53af744 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:52:59.960452 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b6814260-5044-402a-881b-8cf7a53af744 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:59.960868 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b6814260-5044-402a-881b-8cf7a53af744 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:52:59.961625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b6814260-5044-402a-881b-8cf7a53af744 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:52:59.962048 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b6814260-5044-402a-881b-8cf7a53af744 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:00.092675 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b6814260-5044-402a-881b-8cf7a53af744 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:00.100124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b6814260-5044-402a-881b-8cf7a53af744 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1673 microversion: 2.1 time: 0.150267 Jul 20 22:53:00.100686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 320/638] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:52:59 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:00.105098 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e84ca365-3ee2-4a46-8f78-a8cd7bdbe281 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:00.105684 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e84ca365-3ee2-4a46-8f78-a8cd7bdbe281 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:00.111354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e84ca365-3ee2-4a46-8f78-a8cd7bdbe281 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:00.111804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e84ca365-3ee2-4a46-8f78-a8cd7bdbe281 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:00.112570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e84ca365-3ee2-4a46-8f78-a8cd7bdbe281 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:00.113004 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e84ca365-3ee2-4a46-8f78-a8cd7bdbe281 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:00.246682 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e84ca365-3ee2-4a46-8f78-a8cd7bdbe281 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:00.254079 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e84ca365-3ee2-4a46-8f78-a8cd7bdbe281 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1506 microversion: 2.1 time: 0.152420 Jul 20 22:53:00.254647 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 321/639] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:00 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:00.259121 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d9f295ad-b698-4397-8d03-562e21f1266f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:00.259728 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d9f295ad-b698-4397-8d03-562e21f1266f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:00.266955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9f295ad-b698-4397-8d03-562e21f1266f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:00.267501 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9f295ad-b698-4397-8d03-562e21f1266f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:00.269646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9f295ad-b698-4397-8d03-562e21f1266f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:00.269646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9f295ad-b698-4397-8d03-562e21f1266f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:00.302315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:53:00.302787 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:53:00.303331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:53:00.303828 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:53:00.304326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:53:00.314130 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:00.314711 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:00.316091 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:00.316091 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:00.335426 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Getting quotas for project a257ecd598a74a5cb15fc4b62c5a5979. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:53:00.341708 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Getting quotas for user 3ce4c02d3e314761ba613a802194b709 and project a257ecd598a74a5cb15fc4b62c5a5979. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:53:00.404404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:53:00.406225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d9f295ad-b698-4397-8d03-562e21f1266f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:00.407774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='421cdc51-c6b2-48ac-bdbf-716222acde6f',volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:53:00.415440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d9f295ad-b698-4397-8d03-562e21f1266f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.159602 Jul 20 22:53:00.416154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 322/640] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:00 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:00.898701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2c6ec020-a8e5-4bea-975a-c697b47fad17 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.183660 Jul 20 22:53:00.899529 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 319/641] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:52:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 22:53:00.909362 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c090af2b-1b47-4dc6-9fa0-33554e958fb9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:00.910071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c090af2b-1b47-4dc6-9fa0-33554e958fb9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:00.964045 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c090af2b-1b47-4dc6-9fa0-33554e958fb9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:00.971390 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c090af2b-1b47-4dc6-9fa0-33554e958fb9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1088 microversion: 2.1 time: 0.065891 Jul 20 22:53:00.971934 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 323/642] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:00 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:01.118194 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-64e68b4e-9633-427d-8db9-1387d05dcc2d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:01.118836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-64e68b4e-9633-427d-8db9-1387d05dcc2d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:01.128440 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64e68b4e-9633-427d-8db9-1387d05dcc2d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:01.129187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64e68b4e-9633-427d-8db9-1387d05dcc2d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:01.130145 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64e68b4e-9633-427d-8db9-1387d05dcc2d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:01.130732 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-64e68b4e-9633-427d-8db9-1387d05dcc2d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:01.272760 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-df1b9c56-5ed7-406c-986b-a8e88f2db0b3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:01.273233 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-df1b9c56-5ed7-406c-986b-a8e88f2db0b3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:01.283453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-df1b9c56-5ed7-406c-986b-a8e88f2db0b3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:01.284210 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-df1b9c56-5ed7-406c-986b-a8e88f2db0b3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:01.285000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-df1b9c56-5ed7-406c-986b-a8e88f2db0b3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:01.285440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-df1b9c56-5ed7-406c-986b-a8e88f2db0b3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:01.410365 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-64e68b4e-9633-427d-8db9-1387d05dcc2d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:01.422953 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-64e68b4e-9633-427d-8db9-1387d05dcc2d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1673 microversion: 2.1 time: 0.308694 Jul 20 22:53:01.425740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 320/643] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:01 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1673 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:01.435144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-570a86d3-8d10-4068-a080-b6010b05d759 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:01.436147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-570a86d3-8d10-4068-a080-b6010b05d759 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:01.446906 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-570a86d3-8d10-4068-a080-b6010b05d759 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:01.447291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-570a86d3-8d10-4068-a080-b6010b05d759 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:01.448022 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-570a86d3-8d10-4068-a080-b6010b05d759 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:01.448454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-570a86d3-8d10-4068-a080-b6010b05d759 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:01.630477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-df1b9c56-5ed7-406c-986b-a8e88f2db0b3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:01.650174 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-df1b9c56-5ed7-406c-986b-a8e88f2db0b3 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1506 microversion: 2.1 time: 0.381874 Jul 20 22:53:01.651358 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 324/644] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:01 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:53:01.744837 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-570a86d3-8d10-4068-a080-b6010b05d759 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:01.752976 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-570a86d3-8d10-4068-a080-b6010b05d759 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.324322 Jul 20 22:53:01.753548 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 321/645] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:01 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:01.989888 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7a3cd618-d285-4fea-bc14-55fae3df62e6 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:01.990506 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7a3cd618-d285-4fea-bc14-55fae3df62e6 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:02.075654 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7a3cd618-d285-4fea-bc14-55fae3df62e6 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:02.085990 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7a3cd618-d285-4fea-bc14-55fae3df62e6 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1088 microversion: 2.1 time: 0.100960 Jul 20 22:53:02.087335 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 325/646] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:01 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1088 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:02.122356 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-01c76c53-cc9c-4b77-8bed-9ed48350cb14 req-5be1f038-4ed6-4b7a-8a4f-9624b654fa8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd16033e-a51a-43c6-9926-7d4fc9b96bd1", "name": "network-vif-deleted", "tag": "417af98e-97a4-4636-8e23-5904d61a9d52"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:02.133630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-01c76c53-cc9c-4b77-8bed-9ed48350cb14 req-5be1f038-4ed6-4b7a-8a4f-9624b654fa8f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.134491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-01c76c53-cc9c-4b77-8bed-9ed48350cb14 req-5be1f038-4ed6-4b7a-8a4f-9624b654fa8f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.148199 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-01c76c53-cc9c-4b77-8bed-9ed48350cb14 req-5be1f038-4ed6-4b7a-8a4f-9624b654fa8f service nova] Creating event network-vif-deleted:417af98e-97a4-4636-8e23-5904d61a9d52 for instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 on hv-cinder-79987 Jul 20 22:53:02.154576 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-01c76c53-cc9c-4b77-8bed-9ed48350cb14 req-5be1f038-4ed6-4b7a-8a4f-9624b654fa8f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037665 Jul 20 22:53:02.155540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 322/647] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:02.300659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-887c5ae9-9a25-4c7b-b814-49ea91f71086 req-086d1936-ecc4-4df8-822b-8dd396b1af8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cce8a500-8166-4cb3-bc33-41c35ef48651", "name": "network-vif-deleted", "tag": "10d19aff-cf1c-4e78-abf5-f4fd95873ab9"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:02.314527 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-887c5ae9-9a25-4c7b-b814-49ea91f71086 req-086d1936-ecc4-4df8-822b-8dd396b1af8b service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.314967 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-887c5ae9-9a25-4c7b-b814-49ea91f71086 req-086d1936-ecc4-4df8-822b-8dd396b1af8b service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.349535 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-887c5ae9-9a25-4c7b-b814-49ea91f71086 req-086d1936-ecc4-4df8-822b-8dd396b1af8b service nova] Creating event network-vif-deleted:10d19aff-cf1c-4e78-abf5-f4fd95873ab9 for instance cce8a500-8166-4cb3-bc33-41c35ef48651 on hv-cinder-79987 Jul 20 22:53:02.358755 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-887c5ae9-9a25-4c7b-b814-49ea91f71086 req-086d1936-ecc4-4df8-822b-8dd396b1af8b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061794 Jul 20 22:53:02.363794 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 326/648] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:02.441945 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6dca6d28-6e73-4c64-8291-a14886090af5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:02.442649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6dca6d28-6e73-4c64-8291-a14886090af5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:02.449827 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6dca6d28-6e73-4c64-8291-a14886090af5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.450679 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6dca6d28-6e73-4c64-8291-a14886090af5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.451652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6dca6d28-6e73-4c64-8291-a14886090af5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.452087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6dca6d28-6e73-4c64-8291-a14886090af5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.549342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6dca6d28-6e73-4c64-8291-a14886090af5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:02.559092 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6dca6d28-6e73-4c64-8291-a14886090af5 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1606 microversion: 2.1 time: 0.122055 Jul 20 22:53:02.560087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 323/649] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:02 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1606 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:02.668570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:02.669347 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:02.675690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.676138 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.679974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.679974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.716719 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.717408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.717866 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lazy-loading 'fault' on Instance uuid bd16033e-a51a-43c6-9926-7d4fc9b96bd1 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:53:02.768792 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:02.771652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0d662824-dfb4-4e2a-87d5-7b9df1aeb1d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:02.771652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0d662824-dfb4-4e2a-87d5-7b9df1aeb1d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:02.776713 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0d662824-dfb4-4e2a-87d5-7b9df1aeb1d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.777394 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0d662824-dfb4-4e2a-87d5-7b9df1aeb1d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.778154 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0d662824-dfb4-4e2a-87d5-7b9df1aeb1d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:02.778578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0d662824-dfb4-4e2a-87d5-7b9df1aeb1d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:02.778724 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-eeaac057-164c-487d-82a4-25f48a4d628b tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 200 len: 1311 microversion: 2.1 time: 0.114420 Jul 20 22:53:02.779695 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 327/650] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:02 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:02.799111 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:02.915726 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0d662824-dfb4-4e2a-87d5-7b9df1aeb1d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:02.923454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0d662824-dfb4-4e2a-87d5-7b9df1aeb1d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.157262 Jul 20 22:53:02.924112 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 324/651] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:02 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:53:03.103334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-323d092a-4ca6-4ece-8c6c-04e3a0c2699c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:03.103920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-323d092a-4ca6-4ece-8c6c-04e3a0c2699c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:03.110504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-323d092a-4ca6-4ece-8c6c-04e3a0c2699c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.110943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-323d092a-4ca6-4ece-8c6c-04e3a0c2699c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.111928 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-323d092a-4ca6-4ece-8c6c-04e3a0c2699c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.112164 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-323d092a-4ca6-4ece-8c6c-04e3a0c2699c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.177007 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-323d092a-4ca6-4ece-8c6c-04e3a0c2699c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:03.184736 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-323d092a-4ca6-4ece-8c6c-04e3a0c2699c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1186 microversion: 2.1 time: 0.085537 Jul 20 22:53:03.185295 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 328/652] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:03 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:03.577368 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:03.578007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:03.584686 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.585154 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.585973 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.586411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.619635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.620078 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.620523 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lazy-loading 'fault' on Instance uuid cce8a500-8166-4cb3-bc33-41c35ef48651 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:53:03.661637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:03.669022 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d27a5b73-fe9c-487d-861a-8c510e48d684 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 200 len: 1327 microversion: 2.1 time: 0.095633 Jul 20 22:53:03.669580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 325/653] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:03 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:03.797220 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:03.797826 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: bd16033e-a51a-43c6-9926-7d4fc9b96bd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:03.804121 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.804572 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.805351 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.805787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.821642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] HTTP exception thrown: Instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 could not be found. Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Request method failure captured: Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 HTTP/1.1 Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWQRNS5QEz_nIx7JpWo3eYPJN2oyFpU7Oa8tzB_exObv7ffo-e51nONWbNwbw_pURsJUKw8Q9iXUPR0igSGfrFxGoD4dwenCxyjEfmDfXIFNCANufGETvsNlinmX78kKFdqLWyz0d4rSgkr5GWAaNPLzpYmmxW3UJtAqqDUqn7ZiCE Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:53:03.823922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_55c688e93c2b414ca86a3c2f9ec84798", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 1ed9249b2a9b42d9972ed71c04f2c888 Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 could not be found. Jul 20 22:53:03.827338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'bd16033e-a51a-43c6-9926-7d4fc9b96bd1'} Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 could not be found. Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:53:03.828311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 could not be found. Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 could not be found. Jul 20 22:53:03.829768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:53:03.831125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Returning 404 to user: Instance bd16033e-a51a-43c6-9926-7d4fc9b96bd1 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:53:03.831125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9ac05de6-b0ab-4c47-94fd-c10dc824f468 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1" status: 404 len: 111 microversion: 2.1 time: 0.031996 Jul 20 22:53:03.831125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 329/654] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:03 2022] GET /compute/v2.1/servers/bd16033e-a51a-43c6-9926-7d4fc9b96bd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:53:03.835117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1a7eab6d-f014-4d28-ae70-41327f11983d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:03.835795 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1a7eab6d-f014-4d28-ae70-41327f11983d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:03.841863 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a7eab6d-f014-4d28-ae70-41327f11983d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.842414 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a7eab6d-f014-4d28-ae70-41327f11983d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.843276 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a7eab6d-f014-4d28-ae70-41327f11983d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.843780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1a7eab6d-f014-4d28-ae70-41327f11983d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.862055 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:03.869458 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-8c157837-d99c-4419-a50a-3e74b248e191 req-ec7c9bc6-070e-49a7-a260-8db9c835f688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed223901-02ac-40e4-a5df-9d4a3dedc2d2", "name": "network-vif-plugged", "status": "completed", "tag": "806d0645-f98f-443f-8a84-c9eb87d740ca"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:03.869935 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1a7eab6d-f014-4d28-ae70-41327f11983d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:53:03.877780 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-8c157837-d99c-4419-a50a-3e74b248e191 req-ec7c9bc6-070e-49a7-a260-8db9c835f688 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.878209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-8c157837-d99c-4419-a50a-3e74b248e191 req-ec7c9bc6-070e-49a7-a260-8db9c835f688 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.889909 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-8c157837-d99c-4419-a50a-3e74b248e191 req-ec7c9bc6-070e-49a7-a260-8db9c835f688 service nova] Creating event network-vif-plugged:806d0645-f98f-443f-8a84-c9eb87d740ca for instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 on hv-cinder-79987 Jul 20 22:53:03.895060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-8c157837-d99c-4419-a50a-3e74b248e191 req-ec7c9bc6-070e-49a7-a260-8db9c835f688 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088806 Jul 20 22:53:03.895649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 326/655] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:53:03.943406 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d66b7546-8aa1-4578-8db3-6c2cb2dd2b49 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:03.944332 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d66b7546-8aa1-4578-8db3-6c2cb2dd2b49 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:03.953530 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d66b7546-8aa1-4578-8db3-6c2cb2dd2b49 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.953986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d66b7546-8aa1-4578-8db3-6c2cb2dd2b49 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:03.954861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d66b7546-8aa1-4578-8db3-6c2cb2dd2b49 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:03.955294 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d66b7546-8aa1-4578-8db3-6c2cb2dd2b49 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:04.182059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d66b7546-8aa1-4578-8db3-6c2cb2dd2b49 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:04.190460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d66b7546-8aa1-4578-8db3-6c2cb2dd2b49 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.251811 Jul 20 22:53:04.201018 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 327/656] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:03 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:53:04.203293 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1a7eab6d-f014-4d28-ae70-41327f11983d tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 204 len: 0 microversion: 2.1 time: 0.371869 Jul 20 22:53:04.204112 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 330/657] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:53:03 2022] DELETE /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:53:04.207423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1ec995f2-dd2f-4eb8-8ef6-d52c31501872 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:04.207423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1ec995f2-dd2f-4eb8-8ef6-d52c31501872 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:04.213678 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-32dc2645-3a1c-466a-9e9e-88a412f02fde tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:04.214295 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-32dc2645-3a1c-466a-9e9e-88a412f02fde tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:04.214421 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ec995f2-dd2f-4eb8-8ef6-d52c31501872 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:04.214831 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ec995f2-dd2f-4eb8-8ef6-d52c31501872 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:04.215771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ec995f2-dd2f-4eb8-8ef6-d52c31501872 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:04.216236 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ec995f2-dd2f-4eb8-8ef6-d52c31501872 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:04.221802 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-32dc2645-3a1c-466a-9e9e-88a412f02fde tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:04.222480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-32dc2645-3a1c-466a-9e9e-88a412f02fde tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:04.223470 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-32dc2645-3a1c-466a-9e9e-88a412f02fde tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:04.224087 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-32dc2645-3a1c-466a-9e9e-88a412f02fde tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:04.290693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1ec995f2-dd2f-4eb8-8ef6-d52c31501872 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:04.299414 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1ec995f2-dd2f-4eb8-8ef6-d52c31501872 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1204 microversion: 2.1 time: 0.097161 Jul 20 22:53:04.300111 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 328/658] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:04 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1204 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:04.363231 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-32dc2645-3a1c-466a-9e9e-88a412f02fde tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:04.370683 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-32dc2645-3a1c-466a-9e9e-88a412f02fde tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.161833 Jul 20 22:53:04.371273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 331/659] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:04 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:53:04.689186 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:04.689795 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:04.695836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:04.696277 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:04.697525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:04.697954 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:04.711561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] HTTP exception thrown: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Request method failure captured: Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 HTTP/1.1 Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWNmy7FE2vyOlDRdFCAoOGsKyn5qkZMxmmeBNge6TOm-mXAvDieQfAARtQ2jSoV_UqcFifd0hQzvBRFkLsa1bdnjB91E2UcGkaNduVPVjeVgQi52pF8ka0f2rDdUH8lY35-KdtE4WFwBgYe1g3juOeuHIdr0VekldXgcnj5bnPKhq0 Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:53:04.713666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_90ac023afcb44b5097539298076c0838", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/90ac023afcb44b5097539298076c0838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 0cf649be0c48492f8926f4436cbb3d6d Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:53:04.714981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'cce8a500-8166-4cb3-bc33-41c35ef48651'} Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:53:04.725058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:53:04.726326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:04.727557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Returning 404 to user: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:53:04.727557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6f2a1b3f-ae2f-4372-82f1-c33654b9ea1f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 404 len: 111 microversion: 2.1 time: 0.029803 Jul 20 22:53:04.727557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 329/660] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:04 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:53:04.727930 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c064550c-6c1b-4a37-8cc4-78db9ff79cc3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '.version_select at 0x7fe243fb3820>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:04.806213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c064550c-6c1b-4a37-8cc4-78db9ff79cc3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262118265" status: 202 len: 0 microversion: 2.1 time: 0.086033 Jul 20 22:53:04.806923 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 332/661] 10.222.0.81 () {58 vars in 1220 bytes} [Wed Jul 20 22:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262118265 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:53:05.208261 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cc72f56c-f0c5-4d71-b430-11ac302b065c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:05.208891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cc72f56c-f0c5-4d71-b430-11ac302b065c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:05.215421 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc72f56c-f0c5-4d71-b430-11ac302b065c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:05.215862 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc72f56c-f0c5-4d71-b430-11ac302b065c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:05.216630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc72f56c-f0c5-4d71-b430-11ac302b065c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:05.217054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cc72f56c-f0c5-4d71-b430-11ac302b065c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:05.324642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-aabf11b8-3e67-4939-a566-79b55694d342 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:05.325399 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-aabf11b8-3e67-4939-a566-79b55694d342 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:05.338567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aabf11b8-3e67-4939-a566-79b55694d342 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:05.340090 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aabf11b8-3e67-4939-a566-79b55694d342 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:05.344112 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aabf11b8-3e67-4939-a566-79b55694d342 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:05.344650 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aabf11b8-3e67-4939-a566-79b55694d342 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:05.457195 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cc72f56c-f0c5-4d71-b430-11ac302b065c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:05.468232 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cc72f56c-f0c5-4d71-b430-11ac302b065c tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.263874 Jul 20 22:53:05.468842 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 330/662] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:05 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:05.473947 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e3f3d8c7-956a-401f-8c23-af2255892c84 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:05.474724 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e3f3d8c7-956a-401f-8c23-af2255892c84 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:05.481977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3f3d8c7-956a-401f-8c23-af2255892c84 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:05.482932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3f3d8c7-956a-401f-8c23-af2255892c84 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:05.488153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3f3d8c7-956a-401f-8c23-af2255892c84 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:05.488153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3f3d8c7-956a-401f-8c23-af2255892c84 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:05.616588 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-aabf11b8-3e67-4939-a566-79b55694d342 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:05.625135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-aabf11b8-3e67-4939-a566-79b55694d342 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1272 microversion: 2.1 time: 0.311711 Jul 20 22:53:05.635504 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 333/663] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:05 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:05.655581 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e3f3d8c7-956a-401f-8c23-af2255892c84 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:05.668070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-079dcaaf-0279-4f8b-b630-b35042f7c73b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'create', calling method: .version_select at 0x7fe243da4790>, body: {"keypair": {"name": "tempest-keypair-1513260621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMK3R1ulyudETtEHA3zrQb5j/UL2har7enRGXc4M7izvm21FA7HtzBhy/KUwfXvKdPXBEUYWQ8qpkDDgkhR56CBOkuYrtLWBMTkh6pLpZ7axxXxwfLWKg6rSFP3fEQniwQ=="}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:05.669873 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e3f3d8c7-956a-401f-8c23-af2255892c84 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1521 microversion: 2.1 time: 0.199795 Jul 20 22:53:05.670687 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 331/664] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:05 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:05.689027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-079dcaaf-0279-4f8b-b630-b35042f7c73b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Getting quotas for project 90ac023afcb44b5097539298076c0838. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:53:05.693945 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-079dcaaf-0279-4f8b-b630-b35042f7c73b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Getting quotas for user 0cf649be0c48492f8926f4436cbb3d6d and project 90ac023afcb44b5097539298076c0838. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:53:05.858665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-079dcaaf-0279-4f8b-b630-b35042f7c73b tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.197151 Jul 20 22:53:05.859242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 334/665] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 22:53:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:53:06.222466 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-0b14cbb9-7d6b-43b5-87fe-3c97f30dcffa req-4be6b020-0c4c-4c1c-a0f4-777318c20d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed11a51a-3574-43eb-a485-e6df2ded9fee", "name": "network-vif-deleted", "tag": "f1feda7d-23f5-45c6-aa8d-8ed0915aa1ec"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:06.235376 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-0b14cbb9-7d6b-43b5-87fe-3c97f30dcffa req-4be6b020-0c4c-4c1c-a0f4-777318c20d0a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.236172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-0b14cbb9-7d6b-43b5-87fe-3c97f30dcffa req-4be6b020-0c4c-4c1c-a0f4-777318c20d0a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.248418 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-0b14cbb9-7d6b-43b5-87fe-3c97f30dcffa req-4be6b020-0c4c-4c1c-a0f4-777318c20d0a service nova] Creating event network-vif-deleted:f1feda7d-23f5-45c6-aa8d-8ed0915aa1ec for instance ed11a51a-3574-43eb-a485-e6df2ded9fee on hv-cinder-79987 Jul 20 22:53:06.253424 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-0b14cbb9-7d6b-43b5-87fe-3c97f30dcffa req-4be6b020-0c4c-4c1c-a0f4-777318c20d0a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035864 Jul 20 22:53:06.254515 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 332/666] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:06.486895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4028b5d3-6f40-4039-bf18-bc3872fdc4fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:06.487536 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4028b5d3-6f40-4039-bf18-bc3872fdc4fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:06.496339 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4028b5d3-6f40-4039-bf18-bc3872fdc4fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.496775 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4028b5d3-6f40-4039-bf18-bc3872fdc4fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.497863 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4028b5d3-6f40-4039-bf18-bc3872fdc4fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.498609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4028b5d3-6f40-4039-bf18-bc3872fdc4fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.628259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-ad7f7962-0d11-4ecd-9d0d-a17c263bb5da req-55a3cd54-f193-4857-a39d-8d6cc74b7228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7", "tag": "3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:06.649442 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-ad7f7962-0d11-4ecd-9d0d-a17c263bb5da req-55a3cd54-f193-4857-a39d-8d6cc74b7228 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.650730 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-ad7f7962-0d11-4ecd-9d0d-a17c263bb5da req-55a3cd54-f193-4857-a39d-8d6cc74b7228 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.668557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-ad7f7962-0d11-4ecd-9d0d-a17c263bb5da req-55a3cd54-f193-4857-a39d-8d6cc74b7228 service nova] Creating event network-changed:3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf for instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 on hv-cinder-79987 Jul 20 22:53:06.673965 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-ad7f7962-0d11-4ecd-9d0d-a17c263bb5da req-55a3cd54-f193-4857-a39d-8d6cc74b7228 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050347 Jul 20 22:53:06.683778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 333/667] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:06.690354 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6fe23ae0-d932-4282-b646-43f2b4d44d23 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:06.691312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6fe23ae0-d932-4282-b646-43f2b4d44d23 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:06.698833 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6fe23ae0-d932-4282-b646-43f2b4d44d23 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.699327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6fe23ae0-d932-4282-b646-43f2b4d44d23 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.700166 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6fe23ae0-d932-4282-b646-43f2b4d44d23 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.700610 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6fe23ae0-d932-4282-b646-43f2b4d44d23 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.780382 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4028b5d3-6f40-4039-bf18-bc3872fdc4fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:06.797095 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4028b5d3-6f40-4039-bf18-bc3872fdc4fb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1364 microversion: 2.1 time: 0.315129 Jul 20 22:53:06.798368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 335/668] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:06 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:06.804203 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:06.805412 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:06.814072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.814513 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.815874 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.817212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.866404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:06.867322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:06.867987 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lazy-loading 'fault' on Instance uuid ed11a51a-3574-43eb-a485-e6df2ded9fee {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:53:06.930363 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6fe23ae0-d932-4282-b646-43f2b4d44d23 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:06.939124 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6fe23ae0-d932-4282-b646-43f2b4d44d23 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.253764 Jul 20 22:53:06.940631 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ed9249b2a9b42d9972ed71c04f2c888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c688e93c2b414ca86a3c2f9ec84798', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:06.950045 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 334/669] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:06 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:06.955473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8770a4f8-a212-4430-8cf3-f98d18204e41 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 200 len: 1312 microversion: 2.1 time: 0.155745 Jul 20 22:53:06.956601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 336/670] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:06 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:07.813668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d3af36e7-4783-414b-84f4-feb33532258b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:07.814273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d3af36e7-4783-414b-84f4-feb33532258b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:07.820763 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d3af36e7-4783-414b-84f4-feb33532258b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:07.821208 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d3af36e7-4783-414b-84f4-feb33532258b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:07.821992 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d3af36e7-4783-414b-84f4-feb33532258b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:07.822424 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d3af36e7-4783-414b-84f4-feb33532258b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:07.957197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-22b67a13-f6ee-43f2-9c51-2452693e29e3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:07.958332 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-22b67a13-f6ee-43f2-9c51-2452693e29e3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:07.962753 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d3af36e7-4783-414b-84f4-feb33532258b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:07.965445 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22b67a13-f6ee-43f2-9c51-2452693e29e3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:07.966072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22b67a13-f6ee-43f2-9c51-2452693e29e3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:07.967053 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22b67a13-f6ee-43f2-9c51-2452693e29e3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:07.967490 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22b67a13-f6ee-43f2-9c51-2452693e29e3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:07.972590 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d3af36e7-4783-414b-84f4-feb33532258b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1553 microversion: 2.1 time: 0.162803 Jul 20 22:53:07.973339 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 335/671] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:07 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:07.977933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:07.979260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] [instance: ed11a51a-3574-43eb-a485-e6df2ded9fee] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:07.985403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:07.985976 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:07.986833 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:07.987367 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] HTTP exception thrown: Instance ed11a51a-3574-43eb-a485-e6df2ded9fee could not be found. Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Request method failure captured: Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee HTTP/1.1 Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWQRNS5QEz_nIx7JpWo3eYPJN2oyFpU7Oa8tzB_exObv7ffo-e51nONWbNwbw_pURsJUKw8Q9iXUPR0igSGfrFxGoD4dwenCxyjEfmDfXIFNCANufGETvsNlinmX78kKFdqLWyz0d4rSgkr5GWAaNPLzpYmmxW3UJtAqqDUqn7ZiCE Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:53:08.005617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_55c688e93c2b414ca86a3c2f9ec84798", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/55c688e93c2b414ca86a3c2f9ec84798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 55c688e93c2b414ca86a3c2f9ec84798 Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-780387927 Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 1ed9249b2a9b42d9972ed71c04f2c888 Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-ServerRescueNegativeTestJSON-780387927-project Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance ed11a51a-3574-43eb-a485-e6df2ded9fee could not be found. Jul 20 22:53:08.007035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'ed11a51a-3574-43eb-a485-e6df2ded9fee'} Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed11a51a-3574-43eb-a485-e6df2ded9fee could not be found. Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:53:08.007771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed11a51a-3574-43eb-a485-e6df2ded9fee could not be found. Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed11a51a-3574-43eb-a485-e6df2ded9fee could not be found. Jul 20 22:53:08.008894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:53:08.009983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] Returning 404 to user: Instance ed11a51a-3574-43eb-a485-e6df2ded9fee could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:53:08.009983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-60917079-df22-4a99-9ee3-58e49cb86bb8 tempest-ServerRescueNegativeTestJSON-780387927 tempest-ServerRescueNegativeTestJSON-780387927-project] 10.222.0.81 "GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee" status: 404 len: 111 microversion: 2.1 time: 0.030607 Jul 20 22:53:08.009983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 336/672] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:07 2022] GET /compute/v2.1/servers/ed11a51a-3574-43eb-a485-e6df2ded9fee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:53:08.010333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-56c11fe6-c133-4079-8c62-7b4aec903ae8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:08.010988 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-56c11fe6-c133-4079-8c62-7b4aec903ae8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:08.017863 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-56c11fe6-c133-4079-8c62-7b4aec903ae8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:08.018481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-56c11fe6-c133-4079-8c62-7b4aec903ae8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:08.019495 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-56c11fe6-c133-4079-8c62-7b4aec903ae8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:08.019923 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-56c11fe6-c133-4079-8c62-7b4aec903ae8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:08.103976 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-56c11fe6-c133-4079-8c62-7b4aec903ae8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096700 Jul 20 22:53:08.104879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 337/673] 10.222.0.81 () {58 vars in 1274 bytes} [Wed Jul 20 22:53:08 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:08.143580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-22b67a13-f6ee-43f2-9c51-2452693e29e3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:08.151711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-22b67a13-f6ee-43f2-9c51-2452693e29e3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.198403 Jul 20 22:53:08.152875 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 337/674] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:07 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:08.399608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-738033417", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b15c8654-25e9-4d25-a03d-08719b813dd0"}], "security_groups": [{"name": "tempest-securitygroup--147212580"}], "key_name": "tempest-keypair-1513260621", "user_data": "}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:08.627002 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] validate_networks() for [('b15c8654-25e9-4d25-a03d-08719b813dd0', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:53:09.169225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9066c9df-a559-4863-b4a3-0512d12aecce tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:09.169225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9066c9df-a559-4863-b4a3-0512d12aecce tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:09.176480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9066c9df-a559-4863-b4a3-0512d12aecce tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:09.176933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9066c9df-a559-4863-b4a3-0512d12aecce tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:09.177706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9066c9df-a559-4863-b4a3-0512d12aecce tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:09.178313 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9066c9df-a559-4863-b4a3-0512d12aecce tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:09.317236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9066c9df-a559-4863-b4a3-0512d12aecce tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:09.324833 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9066c9df-a559-4863-b4a3-0512d12aecce tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.160639 Jul 20 22:53:09.325394 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 338/675] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:09 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:53:09.938472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:53:09.938937 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:53:09.939419 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:53:09.939864 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:53:09.940279 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:53:09.950406 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:09.950870 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:09.952278 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:09.952887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:09.970813 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Getting quotas for project 90ac023afcb44b5097539298076c0838. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:53:09.974914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Getting quotas for user 0cf649be0c48492f8926f4436cbb3d6d and project 90ac023afcb44b5097539298076c0838. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:53:09.986794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:53:09.989089 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:53:10.149544 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3c7e45ea-8b5c-4d16-87ee-4a3265da2687 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.754114 Jul 20 22:53:10.155978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 338/676] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:53:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:53:10.162012 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-be4d6b91-3467-4224-8513-2c28c75624bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:10.162617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-be4d6b91-3467-4224-8513-2c28c75624bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:10.249328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-be4d6b91-3467-4224-8513-2c28c75624bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:10.256133 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-be4d6b91-3467-4224-8513-2c28c75624bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1237 microversion: 2.1 time: 0.097997 Jul 20 22:53:10.266142 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 339/677] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:10 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:10.341713 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9be80ddf-d14e-4872-8cb5-c8ea40f288a5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:10.342331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9be80ddf-d14e-4872-8cb5-c8ea40f288a5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:10.350224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9be80ddf-d14e-4872-8cb5-c8ea40f288a5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:10.350748 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9be80ddf-d14e-4872-8cb5-c8ea40f288a5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:10.357586 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9be80ddf-d14e-4872-8cb5-c8ea40f288a5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:10.358222 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9be80ddf-d14e-4872-8cb5-c8ea40f288a5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:10.396147 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-e8a1259e-ebb4-4bce-b401-fade0fe1d233 req-5a10c091-8196-4728-88c1-1d60d915b7b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed223901-02ac-40e4-a5df-9d4a3dedc2d2", "tag": "806d0645-f98f-443f-8a84-c9eb87d740ca"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:10.406079 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-e8a1259e-ebb4-4bce-b401-fade0fe1d233 req-5a10c091-8196-4728-88c1-1d60d915b7b6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:10.406516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-e8a1259e-ebb4-4bce-b401-fade0fe1d233 req-5a10c091-8196-4728-88c1-1d60d915b7b6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:10.418078 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-e8a1259e-ebb4-4bce-b401-fade0fe1d233 req-5a10c091-8196-4728-88c1-1d60d915b7b6 service nova] Creating event network-changed:806d0645-f98f-443f-8a84-c9eb87d740ca for instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 on hv-cinder-79987 Jul 20 22:53:10.424018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-e8a1259e-ebb4-4bce-b401-fade0fe1d233 req-5a10c091-8196-4728-88c1-1d60d915b7b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031367 Jul 20 22:53:10.425192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 340/678] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:53:10.601245 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9be80ddf-d14e-4872-8cb5-c8ea40f288a5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:10.609625 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9be80ddf-d14e-4872-8cb5-c8ea40f288a5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.271811 Jul 20 22:53:10.610500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 339/679] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:10 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:11.274609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d210a122-0d7b-4938-b90f-b2b88583d5f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:11.283715 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d210a122-0d7b-4938-b90f-b2b88583d5f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:11.299219 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d210a122-0d7b-4938-b90f-b2b88583d5f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:11.304351 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d210a122-0d7b-4938-b90f-b2b88583d5f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:11.305305 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d210a122-0d7b-4938-b90f-b2b88583d5f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:11.305751 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d210a122-0d7b-4938-b90f-b2b88583d5f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:11.403258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d210a122-0d7b-4938-b90f-b2b88583d5f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:11.413052 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d210a122-0d7b-4938-b90f-b2b88583d5f8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1233 microversion: 2.1 time: 0.142945 Jul 20 22:53:11.413954 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 341/680] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:11 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1233 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:11.628059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-596c9ba4-ad99-4060-83ba-5d26cd2d6d09 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:11.628703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-596c9ba4-ad99-4060-83ba-5d26cd2d6d09 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:11.635498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-596c9ba4-ad99-4060-83ba-5d26cd2d6d09 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:11.635948 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-596c9ba4-ad99-4060-83ba-5d26cd2d6d09 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:11.636716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-596c9ba4-ad99-4060-83ba-5d26cd2d6d09 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:11.637333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-596c9ba4-ad99-4060-83ba-5d26cd2d6d09 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:11.805635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-596c9ba4-ad99-4060-83ba-5d26cd2d6d09 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:11.818446 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-596c9ba4-ad99-4060-83ba-5d26cd2d6d09 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.190974 Jul 20 22:53:11.818446 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 340/681] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:11 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:12.431205 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5426534b-992a-4769-8692-65dd2063d7e3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:12.431812 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5426534b-992a-4769-8692-65dd2063d7e3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:12.438276 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5426534b-992a-4769-8692-65dd2063d7e3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:12.438724 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5426534b-992a-4769-8692-65dd2063d7e3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:12.439545 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5426534b-992a-4769-8692-65dd2063d7e3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:12.439978 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5426534b-992a-4769-8692-65dd2063d7e3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:12.506007 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5426534b-992a-4769-8692-65dd2063d7e3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:12.514938 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5426534b-992a-4769-8692-65dd2063d7e3 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1307 microversion: 2.1 time: 0.087339 Jul 20 22:53:12.516804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 342/682] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:12 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:12.833135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3874d8e1-dd13-4894-b3f2-76c567f84693 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:12.833753 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3874d8e1-dd13-4894-b3f2-76c567f84693 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:12.840470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3874d8e1-dd13-4894-b3f2-76c567f84693 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:12.842050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3874d8e1-dd13-4894-b3f2-76c567f84693 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:12.842050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3874d8e1-dd13-4894-b3f2-76c567f84693 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:12.842477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3874d8e1-dd13-4894-b3f2-76c567f84693 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:12.983843 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3874d8e1-dd13-4894-b3f2-76c567f84693 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:12.992046 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3874d8e1-dd13-4894-b3f2-76c567f84693 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.162917 Jul 20 22:53:13.002460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 341/683] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:12 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:13.533846 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-dfe090ca-3019-42ea-9783-b02e9c808a6c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:13.535114 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-dfe090ca-3019-42ea-9783-b02e9c808a6c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:13.542585 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dfe090ca-3019-42ea-9783-b02e9c808a6c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:13.543314 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dfe090ca-3019-42ea-9783-b02e9c808a6c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:13.544269 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dfe090ca-3019-42ea-9783-b02e9c808a6c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:13.544868 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dfe090ca-3019-42ea-9783-b02e9c808a6c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:13.750467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-dfe090ca-3019-42ea-9783-b02e9c808a6c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:13.758010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-dfe090ca-3019-42ea-9783-b02e9c808a6c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.227921 Jul 20 22:53:13.758590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 343/684] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:13 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:14.010323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2da0ca3f-c334-4d1c-8c15-d649565e749f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:14.015703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2da0ca3f-c334-4d1c-8c15-d649565e749f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:14.023112 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2da0ca3f-c334-4d1c-8c15-d649565e749f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:14.023832 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2da0ca3f-c334-4d1c-8c15-d649565e749f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:14.027512 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2da0ca3f-c334-4d1c-8c15-d649565e749f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:14.028226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2da0ca3f-c334-4d1c-8c15-d649565e749f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:14.196796 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-e9726b20-b104-4be5-a8cb-5d3e65f38de1 req-9e01b357-5366-471b-be33-ec2a059904ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ade60e-70bf-4df4-b465-01bbac79f154", "tag": "bf675cfa-21b6-4533-a61f-f27518f53c13"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:14.209653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-e9726b20-b104-4be5-a8cb-5d3e65f38de1 req-9e01b357-5366-471b-be33-ec2a059904ed service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:14.209653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-e9726b20-b104-4be5-a8cb-5d3e65f38de1 req-9e01b357-5366-471b-be33-ec2a059904ed service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:14.218140 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-e9726b20-b104-4be5-a8cb-5d3e65f38de1 req-9e01b357-5366-471b-be33-ec2a059904ed service nova] Creating event network-changed:bf675cfa-21b6-4533-a61f-f27518f53c13 for instance 91ade60e-70bf-4df4-b465-01bbac79f154 on hv-cinder-79987 Jul 20 22:53:14.223489 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-e9726b20-b104-4be5-a8cb-5d3e65f38de1 req-9e01b357-5366-471b-be33-ec2a059904ed service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029981 Jul 20 22:53:14.224317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 344/685] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:53:14.251230 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2da0ca3f-c334-4d1c-8c15-d649565e749f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:14.259272 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2da0ca3f-c334-4d1c-8c15-d649565e749f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.253523 Jul 20 22:53:14.259887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 342/686] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:14 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:14.777376 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-acf44fbe-355c-4da3-82bc-518b93e090eb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:14.778204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-acf44fbe-355c-4da3-82bc-518b93e090eb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:14.787319 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-acf44fbe-355c-4da3-82bc-518b93e090eb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:14.787848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-acf44fbe-355c-4da3-82bc-518b93e090eb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:14.788838 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-acf44fbe-355c-4da3-82bc-518b93e090eb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:14.789340 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-acf44fbe-355c-4da3-82bc-518b93e090eb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:14.926538 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-acf44fbe-355c-4da3-82bc-518b93e090eb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:14.934699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-acf44fbe-355c-4da3-82bc-518b93e090eb tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.162344 Jul 20 22:53:14.935303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 345/687] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:14 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:15.276094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1f1490d5-afb7-4d1c-93f8-3a3de65a3d08 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:15.276719 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1f1490d5-afb7-4d1c-93f8-3a3de65a3d08 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:15.283584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1f1490d5-afb7-4d1c-93f8-3a3de65a3d08 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:15.289979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1f1490d5-afb7-4d1c-93f8-3a3de65a3d08 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:15.289979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1f1490d5-afb7-4d1c-93f8-3a3de65a3d08 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:15.289979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1f1490d5-afb7-4d1c-93f8-3a3de65a3d08 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:15.502355 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1f1490d5-afb7-4d1c-93f8-3a3de65a3d08 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:15.510980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1f1490d5-afb7-4d1c-93f8-3a3de65a3d08 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.238690 Jul 20 22:53:15.512099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 343/688] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:15 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:15.951412 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-03529d6a-dab6-474f-a2b4-6b4dce29b6a2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:15.952018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-03529d6a-dab6-474f-a2b4-6b4dce29b6a2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:15.958390 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-03529d6a-dab6-474f-a2b4-6b4dce29b6a2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:15.958848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-03529d6a-dab6-474f-a2b4-6b4dce29b6a2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:15.959627 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-03529d6a-dab6-474f-a2b4-6b4dce29b6a2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:15.960058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-03529d6a-dab6-474f-a2b4-6b4dce29b6a2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:16.142036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-03529d6a-dab6-474f-a2b4-6b4dce29b6a2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:16.150208 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-03529d6a-dab6-474f-a2b4-6b4dce29b6a2 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.201985 Jul 20 22:53:16.150784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 346/689] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:15 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:16.527989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-87498b2f-ab7c-4e4f-8be8-ffcb296c9bb2 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:16.528624 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-87498b2f-ab7c-4e4f-8be8-ffcb296c9bb2 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:16.535164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-87498b2f-ab7c-4e4f-8be8-ffcb296c9bb2 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:16.542453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-87498b2f-ab7c-4e4f-8be8-ffcb296c9bb2 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:16.542453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-87498b2f-ab7c-4e4f-8be8-ffcb296c9bb2 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:16.542453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-87498b2f-ab7c-4e4f-8be8-ffcb296c9bb2 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:16.686270 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-87498b2f-ab7c-4e4f-8be8-ffcb296c9bb2 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:16.694224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-87498b2f-ab7c-4e4f-8be8-ffcb296c9bb2 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.170138 Jul 20 22:53:16.694814 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 344/690] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:16 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:17.167428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f214dd7d-11f4-4374-8e83-081bdc6b5eda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:17.168328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f214dd7d-11f4-4374-8e83-081bdc6b5eda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:17.175158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f214dd7d-11f4-4374-8e83-081bdc6b5eda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:17.175614 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f214dd7d-11f4-4374-8e83-081bdc6b5eda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:17.176384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f214dd7d-11f4-4374-8e83-081bdc6b5eda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:17.176818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f214dd7d-11f4-4374-8e83-081bdc6b5eda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:17.307200 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f214dd7d-11f4-4374-8e83-081bdc6b5eda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:17.314659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f214dd7d-11f4-4374-8e83-081bdc6b5eda tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.151701 Jul 20 22:53:17.315274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 347/691] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:17 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:17.711973 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ede349f4-787d-4468-9447-82889ef54dca tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:17.712537 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ede349f4-787d-4468-9447-82889ef54dca tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:17.719134 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ede349f4-787d-4468-9447-82889ef54dca tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:17.719582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ede349f4-787d-4468-9447-82889ef54dca tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:17.720349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ede349f4-787d-4468-9447-82889ef54dca tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:17.720783 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ede349f4-787d-4468-9447-82889ef54dca tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:17.725683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:17.903779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-75dca2ea-f99e-4134-9e95-a0052ca75a12 req-f1351ad3-0f02-40d3-b4b7-a7fadd5910e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7", "name": "network-vif-plugged", "status": "completed", "tag": "3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:17.914299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-75dca2ea-f99e-4134-9e95-a0052ca75a12 req-f1351ad3-0f02-40d3-b4b7-a7fadd5910e1 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:17.917188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-75dca2ea-f99e-4134-9e95-a0052ca75a12 req-f1351ad3-0f02-40d3-b4b7-a7fadd5910e1 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:17.928448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-75dca2ea-f99e-4134-9e95-a0052ca75a12 req-f1351ad3-0f02-40d3-b4b7-a7fadd5910e1 service nova] Creating event network-vif-plugged:3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf for instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 on hv-cinder-79987 Jul 20 22:53:17.933565 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-75dca2ea-f99e-4134-9e95-a0052ca75a12 req-f1351ad3-0f02-40d3-b4b7-a7fadd5910e1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035066 Jul 20 22:53:17.934811 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 348/692] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:18.209336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ede349f4-787d-4468-9447-82889ef54dca tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:18.217930 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ede349f4-787d-4468-9447-82889ef54dca tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.509439 Jul 20 22:53:18.222632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 345/693] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:17 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:18.333367 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a86b354c-76be-4b5b-9f4b-33e3bd4eb995 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:18.334098 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a86b354c-76be-4b5b-9f4b-33e3bd4eb995 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:18.340277 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a86b354c-76be-4b5b-9f4b-33e3bd4eb995 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:18.340722 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a86b354c-76be-4b5b-9f4b-33e3bd4eb995 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:18.341484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a86b354c-76be-4b5b-9f4b-33e3bd4eb995 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:18.342651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a86b354c-76be-4b5b-9f4b-33e3bd4eb995 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:18.558950 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a86b354c-76be-4b5b-9f4b-33e3bd4eb995 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:18.570173 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a86b354c-76be-4b5b-9f4b-33e3bd4eb995 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.241474 Jul 20 22:53:18.579656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 349/694] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:18 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:19.235975 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2827320a-dfe4-43ec-b912-901c0271ca4d tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:19.244237 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2827320a-dfe4-43ec-b912-901c0271ca4d tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:19.244635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2827320a-dfe4-43ec-b912-901c0271ca4d tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:19.245082 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2827320a-dfe4-43ec-b912-901c0271ca4d tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:19.245853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2827320a-dfe4-43ec-b912-901c0271ca4d tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:19.246302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2827320a-dfe4-43ec-b912-901c0271ca4d tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:19.502891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2827320a-dfe4-43ec-b912-901c0271ca4d tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:19.517229 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2827320a-dfe4-43ec-b912-901c0271ca4d tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1260 microversion: 2.1 time: 0.285157 Jul 20 22:53:19.523187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 346/695] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:19 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:19.587590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-234e1366-a097-463e-94bb-b9e1453561a7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:19.588843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-234e1366-a097-463e-94bb-b9e1453561a7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:19.595827 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-234e1366-a097-463e-94bb-b9e1453561a7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:19.596528 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-234e1366-a097-463e-94bb-b9e1453561a7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:19.597649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-234e1366-a097-463e-94bb-b9e1453561a7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:19.598098 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-234e1366-a097-463e-94bb-b9e1453561a7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:19.602845 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:19.773095 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-234e1366-a097-463e-94bb-b9e1453561a7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:19.781367 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-234e1366-a097-463e-94bb-b9e1453561a7 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.197704 Jul 20 22:53:19.781954 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 350/696] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:19 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:20.533835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a6051865-eb89-4d6b-b7fd-36c88e53243c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:20.542536 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a6051865-eb89-4d6b-b7fd-36c88e53243c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:20.542536 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=4 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:20.542536 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=12 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:20.544101 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6051865-eb89-4d6b-b7fd-36c88e53243c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:20.544763 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6051865-eb89-4d6b-b7fd-36c88e53243c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:20.545814 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6051865-eb89-4d6b-b7fd-36c88e53243c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:20.546403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6051865-eb89-4d6b-b7fd-36c88e53243c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:20.703353 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a6051865-eb89-4d6b-b7fd-36c88e53243c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:20.714342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a6051865-eb89-4d6b-b7fd-36c88e53243c tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1443 microversion: 2.1 time: 0.184269 Jul 20 22:53:20.715586 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 347/697] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:20 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1443 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:20.731737 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-da896b2b-8d1f-496a-9d71-e23e1e173b00 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:20.733159 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-da896b2b-8d1f-496a-9d71-e23e1e173b00 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:20.735518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=10 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:20.741512 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da896b2b-8d1f-496a-9d71-e23e1e173b00 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:20.741992 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da896b2b-8d1f-496a-9d71-e23e1e173b00 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:20.743672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da896b2b-8d1f-496a-9d71-e23e1e173b00 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:20.744107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-da896b2b-8d1f-496a-9d71-e23e1e173b00 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:20.802104 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e3ca9150-3001-4cd1-9e52-76bb9d0e8d04 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:20.802728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e3ca9150-3001-4cd1-9e52-76bb9d0e8d04 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:20.809109 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3ca9150-3001-4cd1-9e52-76bb9d0e8d04 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:20.809648 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3ca9150-3001-4cd1-9e52-76bb9d0e8d04 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:20.810411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3ca9150-3001-4cd1-9e52-76bb9d0e8d04 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:20.811164 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3ca9150-3001-4cd1-9e52-76bb9d0e8d04 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:20.953380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-da896b2b-8d1f-496a-9d71-e23e1e173b00 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:20.960659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e3ca9150-3001-4cd1-9e52-76bb9d0e8d04 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:20.962052 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-da896b2b-8d1f-496a-9d71-e23e1e173b00 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1443 microversion: 2.1 time: 0.234088 Jul 20 22:53:20.968835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e3ca9150-3001-4cd1-9e52-76bb9d0e8d04 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.174012 Jul 20 22:53:20.969341 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 348/698] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:20 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:53:20.978064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 351/699] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:20 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1443 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:21.990575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5915bde9-2248-4b02-9b48-2bae54a9e27f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:21.991355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5915bde9-2248-4b02-9b48-2bae54a9e27f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:21.999951 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:22.010321 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5915bde9-2248-4b02-9b48-2bae54a9e27f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:22.010852 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5915bde9-2248-4b02-9b48-2bae54a9e27f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:22.011687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5915bde9-2248-4b02-9b48-2bae54a9e27f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:22.017563 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5915bde9-2248-4b02-9b48-2bae54a9e27f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:22.207335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-50bf8bc8-e4ce-42cb-b60d-75c2fcc350a9 req-debb9362-a75d-42ee-9108-cb4c1720e6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ade60e-70bf-4df4-b465-01bbac79f154", "name": "network-vif-plugged", "status": "completed", "tag": "bf675cfa-21b6-4533-a61f-f27518f53c13"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:22.225245 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-50bf8bc8-e4ce-42cb-b60d-75c2fcc350a9 req-debb9362-a75d-42ee-9108-cb4c1720e6dc service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:22.227152 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-50bf8bc8-e4ce-42cb-b60d-75c2fcc350a9 req-debb9362-a75d-42ee-9108-cb4c1720e6dc service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:22.244468 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-50bf8bc8-e4ce-42cb-b60d-75c2fcc350a9 req-debb9362-a75d-42ee-9108-cb4c1720e6dc service nova] Creating event network-vif-plugged:bf675cfa-21b6-4533-a61f-f27518f53c13 for instance 91ade60e-70bf-4df4-b465-01bbac79f154 on hv-cinder-79987 Jul 20 22:53:22.252824 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-50bf8bc8-e4ce-42cb-b60d-75c2fcc350a9 req-debb9362-a75d-42ee-9108-cb4c1720e6dc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053868 Jul 20 22:53:22.253815 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 349/700] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:53:22.406659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5915bde9-2248-4b02-9b48-2bae54a9e27f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:22.422537 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5915bde9-2248-4b02-9b48-2bae54a9e27f tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.437270 Jul 20 22:53:22.436050 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 352/701] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:21 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:22.788908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-abe7da74-7e28-416f-8685-a49153b9fc88 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'create', calling method: .version_select at 0x7fe243d970d0>, body: {"keypair": {"name": "tempest-keypair-834038787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD/nnAX7evs46/MopxzL3LeGO+MuIVjvnkAguP4oaZaE528x8cgdTmF4LYk56apvPTaFGRhJDKDAjF/Hn6pcPUVgXOiZqMj/fKKGeRMh/Tls2tXn2hSey47WtXWiL1XPQ=="}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:22.800126 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:22.811797 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-abe7da74-7e28-416f-8685-a49153b9fc88 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Getting quotas for project 7ace18b7cfda4329adb560220ff909cc. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:53:22.817029 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-abe7da74-7e28-416f-8685-a49153b9fc88 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Getting quotas for user bc19753d420840ffa5cde19d4c1fac8f and project 7ace18b7cfda4329adb560220ff909cc. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:53:22.891327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-abe7da74-7e28-416f-8685-a49153b9fc88 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.311131 Jul 20 22:53:22.891952 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 350/702] 10.222.0.81 () {62 vars in 1199 bytes} [Wed Jul 20 22:53:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 313 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 22:53:23.456061 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ea76dd99-90ad-4005-8e29-d982e2710097 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:23.457107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ea76dd99-90ad-4005-8e29-d982e2710097 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:23.465779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ea76dd99-90ad-4005-8e29-d982e2710097 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:23.466380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ea76dd99-90ad-4005-8e29-d982e2710097 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:23.467601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ea76dd99-90ad-4005-8e29-d982e2710097 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:23.468149 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ea76dd99-90ad-4005-8e29-d982e2710097 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:23.646755 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ea76dd99-90ad-4005-8e29-d982e2710097 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:23.664422 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ea76dd99-90ad-4005-8e29-d982e2710097 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1362 microversion: 2.1 time: 0.209383 Jul 20 22:53:23.674039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 353/703] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:23 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:23.849496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-87600422-261a-427e-a324-57cc9d322b2c req-20ab22aa-c66f-4fdc-809c-e3fe074ad8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7", "tag": "3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:23.866237 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-87600422-261a-427e-a324-57cc9d322b2c req-20ab22aa-c66f-4fdc-809c-e3fe074ad8a9 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:23.866691 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-87600422-261a-427e-a324-57cc9d322b2c req-20ab22aa-c66f-4fdc-809c-e3fe074ad8a9 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:23.889940 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-87600422-261a-427e-a324-57cc9d322b2c req-20ab22aa-c66f-4fdc-809c-e3fe074ad8a9 service nova] Creating event network-changed:3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf for instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 on hv-cinder-79987 Jul 20 22:53:23.896329 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-87600422-261a-427e-a324-57cc9d322b2c req-20ab22aa-c66f-4fdc-809c-e3fe074ad8a9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050767 Jul 20 22:53:23.897538 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 351/704] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:53:24.684702 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e174c894-9959-430e-a513-f44828f284e8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:24.685336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e174c894-9959-430e-a513-f44828f284e8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:24.713725 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e174c894-9959-430e-a513-f44828f284e8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:24.714190 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e174c894-9959-430e-a513-f44828f284e8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:24.721184 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e174c894-9959-430e-a513-f44828f284e8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:24.721184 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e174c894-9959-430e-a513-f44828f284e8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:25.014757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e174c894-9959-430e-a513-f44828f284e8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:25.025804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e174c894-9959-430e-a513-f44828f284e8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1549 microversion: 2.1 time: 0.347484 Jul 20 22:53:25.029974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 354/705] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:53:24 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1549 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:53:25.052673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d0f51778-1e90-44f6-8621-c0541ed6820a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:25.054270 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d0f51778-1e90-44f6-8621-c0541ed6820a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:25.069008 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d0f51778-1e90-44f6-8621-c0541ed6820a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:25.069458 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d0f51778-1e90-44f6-8621-c0541ed6820a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:25.070237 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d0f51778-1e90-44f6-8621-c0541ed6820a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:25.070730 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d0f51778-1e90-44f6-8621-c0541ed6820a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:25.213351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d0f51778-1e90-44f6-8621-c0541ed6820a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172110 Jul 20 22:53:25.213993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 352/706] 10.222.0.81 () {58 vars in 1274 bytes} [Wed Jul 20 22:53:25 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:26.291123 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1942985284", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c618a1c-50e1-4062-bdfe-9e52756a99e5"}], "security_groups": [{"name": "tempest-securitygroup--1358295425"}], "key_name": "tempest-keypair-834038787", "user_data": "}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:26.448361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] validate_networks() for [('4c618a1c-50e1-4062-bdfe-9e52756a99e5', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:53:27.095352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-2f847e12-8ed5-4f4e-b063-03948bb1b19a req-c34bc64c-0405-4add-863c-3fd9d34fea0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91ade60e-70bf-4df4-b465-01bbac79f154", "tag": "bf675cfa-21b6-4533-a61f-f27518f53c13"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:27.105310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-2f847e12-8ed5-4f4e-b063-03948bb1b19a req-c34bc64c-0405-4add-863c-3fd9d34fea0d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:27.105758 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-2f847e12-8ed5-4f4e-b063-03948bb1b19a req-c34bc64c-0405-4add-863c-3fd9d34fea0d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:27.122088 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:53:27.122948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:53:27.123698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:53:27.124104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:53:27.124659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:53:27.134005 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-2f847e12-8ed5-4f4e-b063-03948bb1b19a req-c34bc64c-0405-4add-863c-3fd9d34fea0d service nova] Creating event network-changed:bf675cfa-21b6-4533-a61f-f27518f53c13 for instance 91ade60e-70bf-4df4-b465-01bbac79f154 on hv-cinder-79987 Jul 20 22:53:27.135225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:27.135896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:27.136757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:27.137432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:27.139304 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-2f847e12-8ed5-4f4e-b063-03948bb1b19a req-c34bc64c-0405-4add-863c-3fd9d34fea0d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047844 Jul 20 22:53:27.139970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 353/707] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:53:27.156000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Getting quotas for project 7ace18b7cfda4329adb560220ff909cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:53:27.160209 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Getting quotas for user bc19753d420840ffa5cde19d4c1fac8f and project 7ace18b7cfda4329adb560220ff909cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:53:27.172614 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:53:27.175322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:53:27.327138 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0be62262-be48-403f-bfc3-6bf5618cea65 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.040285 Jul 20 22:53:27.328571 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 355/708] 10.222.0.81 () {62 vars in 1187 bytes} [Wed Jul 20 22:53:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 22:53:27.340193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c9822b91-97d5-4540-aeec-cbf2b4bc928c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:27.340895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c9822b91-97d5-4540-aeec-cbf2b4bc928c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:27.421578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c9822b91-97d5-4540-aeec-cbf2b4bc928c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:27.434310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c9822b91-97d5-4540-aeec-cbf2b4bc928c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:27.439527 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c9822b91-97d5-4540-aeec-cbf2b4bc928c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:27.442561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c9822b91-97d5-4540-aeec-cbf2b4bc928c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1281 microversion: 2.20 time: 0.107284 Jul 20 22:53:27.443377 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 354/709] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:27 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:28.462390 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8660c261-7108-40d0-88a9-6075a08e7099 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:28.463208 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8660c261-7108-40d0-88a9-6075a08e7099 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:28.520030 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8660c261-7108-40d0-88a9-6075a08e7099 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:28.527753 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8660c261-7108-40d0-88a9-6075a08e7099 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:28.529250 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8660c261-7108-40d0-88a9-6075a08e7099 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:28.530259 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8660c261-7108-40d0-88a9-6075a08e7099 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1281 microversion: 2.20 time: 0.072727 Jul 20 22:53:28.530804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 356/710] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:28 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:29.548699 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:29.549849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:29.557442 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:29.557908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:29.558694 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:29.559176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:29.620941 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:29.628925 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:29.630580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:29.631701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9c59a72e-af26-4a1b-ac38-c66e5beea4ab tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1333 microversion: 2.20 time: 0.087031 Jul 20 22:53:29.632251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 355/711] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:29 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:53:30.650957 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:30.651662 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:30.658543 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:30.658998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:30.659895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:30.660357 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:30.803926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:30.812679 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:30.814501 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:30.815981 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-322a7b07-de05-4136-b5bf-317d21492151 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.170003 Jul 20 22:53:30.816630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 357/712] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:30 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:53:31.505794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-7832b05b-d6fc-450f-be26-391c7e91483e req-bb8d22b2-2b93-4c11-93ef-9b1dc74c8af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dca5cf4-1a98-44f6-bcfe-dba13d327330", "tag": "bc39b14d-82b6-414a-8492-34acd0bf0123"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:31.515949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-7832b05b-d6fc-450f-be26-391c7e91483e req-bb8d22b2-2b93-4c11-93ef-9b1dc74c8af5 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:31.516395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-7832b05b-d6fc-450f-be26-391c7e91483e req-bb8d22b2-2b93-4c11-93ef-9b1dc74c8af5 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:31.535650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-7832b05b-d6fc-450f-be26-391c7e91483e req-bb8d22b2-2b93-4c11-93ef-9b1dc74c8af5 service nova] Creating event network-changed:bc39b14d-82b6-414a-8492-34acd0bf0123 for instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 on hv-cinder-79987 Jul 20 22:53:31.541407 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-7832b05b-d6fc-450f-be26-391c7e91483e req-bb8d22b2-2b93-4c11-93ef-9b1dc74c8af5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041561 Jul 20 22:53:31.542228 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 356/713] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:31.835515 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:31.836154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:31.843002 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:31.843482 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:31.844251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:31.844676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:31.984511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:31.992901 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:31.994681 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:31.995798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-17939fdd-4515-4cd4-ad46-b7910a08bd25 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.164246 Jul 20 22:53:31.996349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 358/714] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:31 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:33.015222 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:33.015840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:33.022274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:33.022727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:33.023513 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:33.024576 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:33.154406 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:33.162527 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:33.164070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:33.165208 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a5f5c049-a5d1-490c-aaef-0109fea953df tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.155373 Jul 20 22:53:33.165765 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 357/715] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:33 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:34.182355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:34.182964 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:34.189597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:34.190078 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:34.190845 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:34.191308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:34.323710 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:34.331513 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:34.333016 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:34.334097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-41ebaa62-b715-4784-8f78-b56b4b9e77c1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.155749 Jul 20 22:53:34.334655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 359/716] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:34 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:35.352619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:35.353226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:35.359855 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:35.360300 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:35.361058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:35.361489 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:35.491132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:35.499220 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:35.500712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:35.501803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1ab3527f-df10-4b9c-98c7-cc6618588517 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.153146 Jul 20 22:53:35.502355 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 358/717] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:35 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:36.519422 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:36.520205 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:36.527299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:36.527746 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:36.528511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:36.528941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:36.661536 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:36.669455 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:36.670944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:36.672067 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b1568e45-e4af-4c78-b53b-29c00ad054b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.156680 Jul 20 22:53:36.672681 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 360/718] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:36 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:37.690258 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:37.690895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:37.693353 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=6 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:37.698263 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:37.698707 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:37.699488 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:37.699968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:37.832750 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:37.840818 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:37.884264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:37.884264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8ec3db5f-b469-4c41-9fc4-98df52bdb109 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.157033 Jul 20 22:53:37.884264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 359/719] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:37 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:37.953634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-dc2feebc-8064-441b-8d24-167a0c8c6f41 req-adfcc8ac-3b7b-49c9-89d2-1bfd382094e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dca5cf4-1a98-44f6-bcfe-dba13d327330", "name": "network-vif-plugged", "status": "completed", "tag": "bc39b14d-82b6-414a-8492-34acd0bf0123"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:37.957211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:37.963756 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-dc2feebc-8064-441b-8d24-167a0c8c6f41 req-adfcc8ac-3b7b-49c9-89d2-1bfd382094e2 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:37.964193 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-dc2feebc-8064-441b-8d24-167a0c8c6f41 req-adfcc8ac-3b7b-49c9-89d2-1bfd382094e2 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:37.976974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-dc2feebc-8064-441b-8d24-167a0c8c6f41 req-adfcc8ac-3b7b-49c9-89d2-1bfd382094e2 service nova] Creating event network-vif-plugged:bc39b14d-82b6-414a-8492-34acd0bf0123 for instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 on hv-cinder-79987 Jul 20 22:53:37.982572 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-dc2feebc-8064-441b-8d24-167a0c8c6f41 req-adfcc8ac-3b7b-49c9-89d2-1bfd382094e2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Jul 20 22:53:37.983179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 361/720] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:53:38.861269 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:38.861877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:38.869383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:38.869824 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:38.870580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:38.871048 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:39.001693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:39.010548 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:39.012105 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:39.013201 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a002d91e-e734-4004-9965-82481a6b3570 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.155884 Jul 20 22:53:39.014014 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 360/721] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:38 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:40.028584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=8 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:40.033226 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:40.033917 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:40.040573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:40.041507 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:40.042258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:40.042691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:40.171721 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:40.181885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:40.183486 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:40.184575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-65eee341-2496-4661-b83c-ea1e2b327a7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1407 microversion: 2.20 time: 0.156998 Jul 20 22:53:40.185163 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 362/722] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:40 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:41.201624 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:41.202232 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:41.208732 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:41.209176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:41.209929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:41.210359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:41.339914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:41.347836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:41.349409 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:53:41.350656 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-23c5d271-2c28-4252-8b99-530dec20e0d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1598 microversion: 2.20 time: 0.152918 Jul 20 22:53:41.351315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 361/723] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:53:41 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:53:41.368857 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1f232399-1fb1-4698-abf5-281c02b30671 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:53:41.376604 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1f232399-1fb1-4698-abf5-281c02b30671 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:53:41.376604 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1f232399-1fb1-4698-abf5-281c02b30671 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:41.376905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1f232399-1fb1-4698-abf5-281c02b30671 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:41.377670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1f232399-1fb1-4698-abf5-281c02b30671 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:41.378108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1f232399-1fb1-4698-abf5-281c02b30671 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:41.454213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1f232399-1fb1-4698-abf5-281c02b30671 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089302 Jul 20 22:53:41.454827 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 363/724] 10.222.0.81 () {60 vars in 1315 bytes} [Wed Jul 20 22:53:41 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:53:42.656771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-f1bdd206-35f3-40c2-8a92-61626b946d02 req-ad5ddeee-18b7-4d29-acd4-34468ab1068b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dca5cf4-1a98-44f6-bcfe-dba13d327330", "tag": "bc39b14d-82b6-414a-8492-34acd0bf0123"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:53:42.665310 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-f1bdd206-35f3-40c2-8a92-61626b946d02 req-ad5ddeee-18b7-4d29-acd4-34468ab1068b service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:53:42.665746 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-f1bdd206-35f3-40c2-8a92-61626b946d02 req-ad5ddeee-18b7-4d29-acd4-34468ab1068b service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:53:42.676654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-f1bdd206-35f3-40c2-8a92-61626b946d02 req-ad5ddeee-18b7-4d29-acd4-34468ab1068b service nova] Creating event network-changed:bc39b14d-82b6-414a-8492-34acd0bf0123 for instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 on hv-cinder-79987 Jul 20 22:53:42.682142 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-f1bdd206-35f3-40c2-8a92-61626b946d02 req-ad5ddeee-18b7-4d29-acd4-34468ab1068b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028511 Jul 20 22:53:42.682740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 362/725] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:25.452473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:25.453185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=66 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:25.457089 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d9830e4d-3d7d-4775-9c9c-5386b20d10e3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:25.457581 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d9830e4d-3d7d-4775-9c9c-5386b20d10e3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:25.463490 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9830e4d-3d7d-4775-9c9c-5386b20d10e3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:25.463940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9830e4d-3d7d-4775-9c9c-5386b20d10e3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:25.464703 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9830e4d-3d7d-4775-9c9c-5386b20d10e3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:25.465134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9830e4d-3d7d-4775-9c9c-5386b20d10e3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:25.488011 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d9830e4d-3d7d-4775-9c9c-5386b20d10e3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/ips" status: 200 len: 148 microversion: 2.1 time: 0.037036 Jul 20 22:54:25.488569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 364/726] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:54:25 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:28.095121 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:28.095871 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=72 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:28.100093 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d1139627-db8e-4a43-8a5e-aad42905ff00 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a6518ff-b20a-4642-ba86-e51031c43944"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:54:28.101234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d1139627-db8e-4a43-8a5e-aad42905ff00 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:28.107567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1139627-db8e-4a43-8a5e-aad42905ff00 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:28.109619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1139627-db8e-4a43-8a5e-aad42905ff00 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:28.109619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1139627-db8e-4a43-8a5e-aad42905ff00 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:28.109619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1139627-db8e-4a43-8a5e-aad42905ff00 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:28.855532 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d1139627-db8e-4a43-8a5e-aad42905ff00 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761736 Jul 20 22:54:28.856207 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 363/727] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:54:28 2022] POST /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:37.390760 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a6518ff-b20a-4642-ba86-e51031c43944"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:54:37.391854 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:37.398897 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:37.401299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:37.401299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:37.401299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:37.477667 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Invalid volume: volume 7a6518ff-b20a-4642-ba86-e51031c43944 is already attached to instances: ed223901-02ac-40e4-a5df-9d4a3dedc2d2 Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: POST /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments HTTP/1.1 Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 74 Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:54:37.480013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {"volumeAttachment": {"volumeId": "7a6518ff-b20a-4642-ba86-e51031c43944"}} Jul 20 22:54:37.481655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Invalid volume: volume 7a6518ff-b20a-4642-ba86-e51031c43944 is already attached to instances: ed223901-02ac-40e4-a5df-9d4a3dedc2d2 Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'server_id': 'ed223901-02ac-40e4-a5df-9d4a3dedc2d2', 'body': {'volumeAttachment': {'volumeId': '7a6518ff-b20a-4642-ba86-e51031c43944'}}} Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a6518ff-b20a-4642-ba86-e51031c43944 is already attached to instances: ed223901-02ac-40e4-a5df-9d4a3dedc2d2 Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:54:37.483392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a6518ff-b20a-4642-ba86-e51031c43944 is already attached to instances: ed223901-02ac-40e4-a5df-9d4a3dedc2d2 Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:54:37.484904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:54:37.486381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:54:37.486381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:54:37.486381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:54:37.486381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a6518ff-b20a-4642-ba86-e51031c43944 is already attached to instances: ed223901-02ac-40e4-a5df-9d4a3dedc2d2 Jul 20 22:54:37.486381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:54:37.486381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 400 to user: Invalid volume: volume 7a6518ff-b20a-4642-ba86-e51031c43944 is already attached to instances: ed223901-02ac-40e4-a5df-9d4a3dedc2d2 {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:54:37.486381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-484f2459-a4db-4aba-a31f-9aaff11d39f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095159 Jul 20 22:54:37.486381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 365/728] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:54:37 2022] POST /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:54:37.542179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-abf2729c-dd5b-41b5-a444-898692a46ef9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:37.542687 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-abf2729c-dd5b-41b5-a444-898692a46ef9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:37.548750 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-abf2729c-dd5b-41b5-a444-898692a46ef9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:37.549189 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-abf2729c-dd5b-41b5-a444-898692a46ef9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:37.549929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-abf2729c-dd5b-41b5-a444-898692a46ef9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:37.550356 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-abf2729c-dd5b-41b5-a444-898692a46ef9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:37.627902 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-abf2729c-dd5b-41b5-a444-898692a46ef9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lazy-loading 'services' on Instance uuid ed223901-02ac-40e4-a5df-9d4a3dedc2d2 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:54:37.816427 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-abf2729c-dd5b-41b5-a444-898692a46ef9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments/7a6518ff-b20a-4642-ba86-e51031c43944" status: 202 len: 0 microversion: 2.1 time: 0.278839 Jul 20 22:54:37.817019 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 364/729] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:54:37 2022] DELETE /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments/7a6518ff-b20a-4642-ba86-e51031c43944 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:54:37.826171 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e6f7e7d3-a05d-4db2-b713-d74fe1ba4df4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:37.827117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e6f7e7d3-a05d-4db2-b713-d74fe1ba4df4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:37.833273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e6f7e7d3-a05d-4db2-b713-d74fe1ba4df4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:37.833721 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e6f7e7d3-a05d-4db2-b713-d74fe1ba4df4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:37.834500 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e6f7e7d3-a05d-4db2-b713-d74fe1ba4df4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:37.834924 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e6f7e7d3-a05d-4db2-b713-d74fe1ba4df4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:37.864475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e6f7e7d3-a05d-4db2-b713-d74fe1ba4df4 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Jul 20 22:54:37.865027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 366/730] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:54:37 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:54:38.877567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f008c706-a73b-40eb-b29d-f274f585b2ed tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:38.878568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f008c706-a73b-40eb-b29d-f274f585b2ed tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:38.885976 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f008c706-a73b-40eb-b29d-f274f585b2ed tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:38.886423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f008c706-a73b-40eb-b29d-f274f585b2ed tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:38.887273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f008c706-a73b-40eb-b29d-f274f585b2ed tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:38.887712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f008c706-a73b-40eb-b29d-f274f585b2ed tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:38.916614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f008c706-a73b-40eb-b29d-f274f585b2ed tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Jul 20 22:54:38.917168 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 365/731] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:54:38 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:39.928066 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-285a582a-99e6-4b7a-bcf4-7def6f198158 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:39.928995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-285a582a-99e6-4b7a-bcf4-7def6f198158 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:39.935777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-285a582a-99e6-4b7a-bcf4-7def6f198158 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:39.936213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-285a582a-99e6-4b7a-bcf4-7def6f198158 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:39.936979 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-285a582a-99e6-4b7a-bcf4-7def6f198158 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:39.937404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-285a582a-99e6-4b7a-bcf4-7def6f198158 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:39.965701 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-285a582a-99e6-4b7a-bcf4-7def6f198158 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041574 Jul 20 22:54:39.966237 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 367/732] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:54:39 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:54:40.022383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e7a91111-f569-4b29-b173-3565bea227cb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:40.022894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e7a91111-f569-4b29-b173-3565bea227cb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:40.030035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7a91111-f569-4b29-b173-3565bea227cb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:40.030484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7a91111-f569-4b29-b173-3565bea227cb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:40.031273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7a91111-f569-4b29-b173-3565bea227cb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:40.031711 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7a91111-f569-4b29-b173-3565bea227cb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:40.057331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e7a91111-f569-4b29-b173-3565bea227cb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:54:40.262506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e7a91111-f569-4b29-b173-3565bea227cb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 204 len: 0 microversion: 2.1 time: 0.243687 Jul 20 22:54:40.263117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 366/733] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:54:40 2022] DELETE /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:54:40.271511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0919750b-0125-42f4-bc0f-1f0524eed2a3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:40.272121 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0919750b-0125-42f4-bc0f-1f0524eed2a3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:40.278685 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0919750b-0125-42f4-bc0f-1f0524eed2a3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:40.279174 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0919750b-0125-42f4-bc0f-1f0524eed2a3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:40.279933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0919750b-0125-42f4-bc0f-1f0524eed2a3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:40.280366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0919750b-0125-42f4-bc0f-1f0524eed2a3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:40.410569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0919750b-0125-42f4-bc0f-1f0524eed2a3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:40.418733 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0919750b-0125-42f4-bc0f-1f0524eed2a3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1677 microversion: 2.1 time: 0.151190 Jul 20 22:54:40.419366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 368/734] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:40 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:41.437314 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-16b13358-f561-4d92-93d8-038f340b8be5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:41.438003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-16b13358-f561-4d92-93d8-038f340b8be5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:41.444570 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-16b13358-f561-4d92-93d8-038f340b8be5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:41.445015 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-16b13358-f561-4d92-93d8-038f340b8be5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:41.445821 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-16b13358-f561-4d92-93d8-038f340b8be5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:41.446203 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-16b13358-f561-4d92-93d8-038f340b8be5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:41.577412 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-16b13358-f561-4d92-93d8-038f340b8be5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:41.584895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-16b13358-f561-4d92-93d8-038f340b8be5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1677 microversion: 2.1 time: 0.151785 Jul 20 22:54:41.585453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 367/735] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:41 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:42.602783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9554ad5f-4901-4107-a9b3-97c86e10a95a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:42.603380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9554ad5f-4901-4107-a9b3-97c86e10a95a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:42.610570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9554ad5f-4901-4107-a9b3-97c86e10a95a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:42.611046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9554ad5f-4901-4107-a9b3-97c86e10a95a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:42.611823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9554ad5f-4901-4107-a9b3-97c86e10a95a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:42.612263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9554ad5f-4901-4107-a9b3-97c86e10a95a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:42.751322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9554ad5f-4901-4107-a9b3-97c86e10a95a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:42.758734 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9554ad5f-4901-4107-a9b3-97c86e10a95a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1677 microversion: 2.1 time: 0.160062 Jul 20 22:54:42.759381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 369/736] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:42 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:43.324102 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-649ffd9b-92b5-4e06-8733-8c8fd4af23cc req-4b112b9a-c01a-49ad-9905-eb49b0ed8d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed223901-02ac-40e4-a5df-9d4a3dedc2d2", "name": "network-vif-deleted", "tag": "806d0645-f98f-443f-8a84-c9eb87d740ca"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:54:43.332505 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-649ffd9b-92b5-4e06-8733-8c8fd4af23cc req-4b112b9a-c01a-49ad-9905-eb49b0ed8d02 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:43.332946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-649ffd9b-92b5-4e06-8733-8c8fd4af23cc req-4b112b9a-c01a-49ad-9905-eb49b0ed8d02 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:43.344778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-649ffd9b-92b5-4e06-8733-8c8fd4af23cc req-4b112b9a-c01a-49ad-9905-eb49b0ed8d02 service nova] Creating event network-vif-deleted:806d0645-f98f-443f-8a84-c9eb87d740ca for instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 on hv-cinder-79987 Jul 20 22:54:43.349659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-649ffd9b-92b5-4e06-8733-8c8fd4af23cc req-4b112b9a-c01a-49ad-9905-eb49b0ed8d02 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029207 Jul 20 22:54:43.350122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 368/737] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:43.775982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:43.776625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:43.783162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:43.783624 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:43.784384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:43.784819 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:43.815432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:43.815895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:43.816317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lazy-loading 'fault' on Instance uuid ed223901-02ac-40e4-a5df-9d4a3dedc2d2 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:54:43.857204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:43.864696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6e15910d-0c5c-4d0c-a7ee-efcff6fff30d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 200 len: 1329 microversion: 2.1 time: 0.093133 Jul 20 22:54:43.865255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 370/738] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:43 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 1329 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:44.883153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:44.883861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:44.891148 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:44.891593 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:44.892350 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:44.892784 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:44.906010 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 HTTP/1.1 Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:54:44.907636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:54:44.909122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'ed223901-02ac-40e4-a5df-9d4a3dedc2d2'} Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:54:44.910026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:54:44.911577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:54:44.912951 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:54:44.912951 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6be6e10d-bb3f-4d43-a818-c2c71b1b323e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 404 len: 111 microversion: 2.1 time: 0.030590 Jul 20 22:54:44.912951 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 369/739] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:44 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:54:44.917741 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0625f5a2-e324-413d-b964-8b0d083bfdad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '.version_select at 0x7fe243e0a940>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:44.982848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0625f5a2-e324-413d-b964-8b0d083bfdad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76324580" status: 202 len: 0 microversion: 2.1 time: 0.068846 Jul 20 22:54:44.983434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 371/740] 10.222.0.81 () {58 vars in 1214 bytes} [Wed Jul 20 22:54:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76324580 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:54:45.730174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-bf01c885-e3da-4f97-8dca-6428a556f518 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: .version_select at 0x7fe243df2940>, body: {"keypair": {"name": "tempest-keypair-1956014211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTqXBIF185KnNcUp5WESI9zr4dGMpTmYZCXPJB9Vdus4PmdwNkLDRBCI6MyKDwC3g0jfD6uYN9clQRGN0XdonhYNOYliwtcQStbuue1hiKe9Cb0i5OaQRke/IdDKY/bRw=="}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:54:45.745464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-bf01c885-e3da-4f97-8dca-6428a556f518 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for project f733781536584f80acfc325bf8444536. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:54:45.749453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-bf01c885-e3da-4f97-8dca-6428a556f518 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for user 3e072e59bf3e46aaa062ec85b0e2c91a and project f733781536584f80acfc325bf8444536. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:54:45.816943 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-bf01c885-e3da-4f97-8dca-6428a556f518 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091607 Jul 20 22:54:45.817554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 370/741] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 22:54:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:47.910819 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1628499336", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b157aec-dd9e-48b2-9003-4eeafc1a43e4"}], "security_groups": [{"name": "tempest-securitygroup--1508178215"}], "key_name": "tempest-keypair-1956014211", "user_data": "}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:54:48.015729 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] validate_networks() for [('6b157aec-dd9e-48b2-9003-4eeafc1a43e4', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:54:48.429669 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:54:48.430156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:54:48.431139 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:54:48.431548 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:54:48.431958 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:54:48.440941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:48.441388 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:48.442185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:48.442621 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:48.459849 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for project f733781536584f80acfc325bf8444536. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:54:48.463762 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Getting quotas for user 3e072e59bf3e46aaa062ec85b0e2c91a and project f733781536584f80acfc325bf8444536. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:54:48.474405 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:54:48.477367 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:54:48.597939 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5a64ce90-c28c-4770-af6d-49fbf42479f9 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692089 Jul 20 22:54:48.598584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 372/742] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:54:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:54:48.609328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-45bba668-5db0-447d-a090-41a826084f3e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:48.609933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-45bba668-5db0-447d-a090-41a826084f3e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:48.671464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-45bba668-5db0-447d-a090-41a826084f3e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:48.678152 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-45bba668-5db0-447d-a090-41a826084f3e tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1242 microversion: 2.1 time: 0.073174 Jul 20 22:54:48.678712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 371/743] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:48 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:54:49.695325 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-aedecacf-335b-4dd8-b95b-0d0139634b29 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:49.695903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-aedecacf-335b-4dd8-b95b-0d0139634b29 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:49.702985 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aedecacf-335b-4dd8-b95b-0d0139634b29 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:49.703457 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aedecacf-335b-4dd8-b95b-0d0139634b29 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:49.704202 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aedecacf-335b-4dd8-b95b-0d0139634b29 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:49.704632 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aedecacf-335b-4dd8-b95b-0d0139634b29 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:49.765863 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-aedecacf-335b-4dd8-b95b-0d0139634b29 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:49.773740 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-aedecacf-335b-4dd8-b95b-0d0139634b29 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1246 microversion: 2.1 time: 0.082734 Jul 20 22:54:49.774322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 373/744] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:49 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:50.791416 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1db4667c-f6c6-46d5-ab40-26eeea2b6b16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:50.792644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1db4667c-f6c6-46d5-ab40-26eeea2b6b16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:50.799184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1db4667c-f6c6-46d5-ab40-26eeea2b6b16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:50.804540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1db4667c-f6c6-46d5-ab40-26eeea2b6b16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:50.804540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1db4667c-f6c6-46d5-ab40-26eeea2b6b16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:50.804540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1db4667c-f6c6-46d5-ab40-26eeea2b6b16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:50.862990 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1db4667c-f6c6-46d5-ab40-26eeea2b6b16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:50.879216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1db4667c-f6c6-46d5-ab40-26eeea2b6b16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1302 microversion: 2.1 time: 0.083656 Jul 20 22:54:50.879216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 372/745] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:50 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:51.887238 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1ea421d6-bc28-442f-bc1b-0aa9eb3ffdc5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:51.887901 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1ea421d6-bc28-442f-bc1b-0aa9eb3ffdc5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:51.894403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1ea421d6-bc28-442f-bc1b-0aa9eb3ffdc5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:51.894855 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1ea421d6-bc28-442f-bc1b-0aa9eb3ffdc5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:51.895654 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1ea421d6-bc28-442f-bc1b-0aa9eb3ffdc5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:51.896094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1ea421d6-bc28-442f-bc1b-0aa9eb3ffdc5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:52.046617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1ea421d6-bc28-442f-bc1b-0aa9eb3ffdc5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:52.057418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1ea421d6-bc28-442f-bc1b-0aa9eb3ffdc5 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1368 microversion: 2.1 time: 0.172669 Jul 20 22:54:52.057777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 374/746] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:51 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:52.236691 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-73f21576-6e25-4acb-9d1f-b50f10512383 req-7be28d40-59ca-4ebe-ba24-109a7a3b58fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a732c09e-e99c-4bac-98ad-00a3a6547cc2", "tag": "9c946aca-d30d-47a8-85d4-39572b50ee93"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:54:52.245875 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-73f21576-6e25-4acb-9d1f-b50f10512383 req-7be28d40-59ca-4ebe-ba24-109a7a3b58fd service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:52.246316 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-73f21576-6e25-4acb-9d1f-b50f10512383 req-7be28d40-59ca-4ebe-ba24-109a7a3b58fd service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:52.257546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-73f21576-6e25-4acb-9d1f-b50f10512383 req-7be28d40-59ca-4ebe-ba24-109a7a3b58fd service nova] Creating event network-changed:9c946aca-d30d-47a8-85d4-39572b50ee93 for instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 on hv-cinder-79987 Jul 20 22:54:52.262931 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-73f21576-6e25-4acb-9d1f-b50f10512383 req-7be28d40-59ca-4ebe-ba24-109a7a3b58fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029804 Jul 20 22:54:52.268575 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 373/747] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:53.074029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d04a4396-0abb-4ef4-88d0-22957a7b49a6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:53.074640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d04a4396-0abb-4ef4-88d0-22957a7b49a6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:53.081107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d04a4396-0abb-4ef4-88d0-22957a7b49a6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:53.081570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d04a4396-0abb-4ef4-88d0-22957a7b49a6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:53.082332 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d04a4396-0abb-4ef4-88d0-22957a7b49a6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:53.082770 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d04a4396-0abb-4ef4-88d0-22957a7b49a6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:53.212261 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d04a4396-0abb-4ef4-88d0-22957a7b49a6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:53.219710 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d04a4396-0abb-4ef4-88d0-22957a7b49a6 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1368 microversion: 2.1 time: 0.150115 Jul 20 22:54:53.220275 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 375/748] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:53 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:54.016732 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-974ca22b-325e-4407-8f47-fd690f8af0d1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:54.017722 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-974ca22b-325e-4407-8f47-fd690f8af0d1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:54.025913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-974ca22b-325e-4407-8f47-fd690f8af0d1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:54.026350 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-974ca22b-325e-4407-8f47-fd690f8af0d1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:54.027140 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-974ca22b-325e-4407-8f47-fd690f8af0d1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:54.027573 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-974ca22b-325e-4407-8f47-fd690f8af0d1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:54.049754 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-974ca22b-325e-4407-8f47-fd690f8af0d1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/ips" status: 200 len: 147 microversion: 2.1 time: 0.038646 Jul 20 22:54:54.050339 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 374/749] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:54:54 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:54.237055 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d3b4396d-c8fb-4dcb-b690-067f04b106c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:54.237670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d3b4396d-c8fb-4dcb-b690-067f04b106c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:54.243773 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d3b4396d-c8fb-4dcb-b690-067f04b106c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:54.244206 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d3b4396d-c8fb-4dcb-b690-067f04b106c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:54.244965 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d3b4396d-c8fb-4dcb-b690-067f04b106c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:54.245397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d3b4396d-c8fb-4dcb-b690-067f04b106c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:54.385404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d3b4396d-c8fb-4dcb-b690-067f04b106c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:54.392528 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d3b4396d-c8fb-4dcb-b690-067f04b106c1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1368 microversion: 2.1 time: 0.159438 Jul 20 22:54:54.393092 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 376/750] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:54 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:55.409368 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-147b3b66-61c3-4739-8407-c467d1463ebb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:55.409985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-147b3b66-61c3-4739-8407-c467d1463ebb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:55.417150 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-147b3b66-61c3-4739-8407-c467d1463ebb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:55.417599 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-147b3b66-61c3-4739-8407-c467d1463ebb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:55.418374 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-147b3b66-61c3-4739-8407-c467d1463ebb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:55.418859 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-147b3b66-61c3-4739-8407-c467d1463ebb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:55.556300 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-147b3b66-61c3-4739-8407-c467d1463ebb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:55.563898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-147b3b66-61c3-4739-8407-c467d1463ebb tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1368 microversion: 2.1 time: 0.158505 Jul 20 22:54:55.564445 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 375/751] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:55 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:56.581119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2f70b2e2-b7d0-4d3a-ba95-3aab95a157e0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:56.581748 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2f70b2e2-b7d0-4d3a-ba95-3aab95a157e0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:56.590006 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f70b2e2-b7d0-4d3a-ba95-3aab95a157e0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:56.590438 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f70b2e2-b7d0-4d3a-ba95-3aab95a157e0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:56.591262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f70b2e2-b7d0-4d3a-ba95-3aab95a157e0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:56.591691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2f70b2e2-b7d0-4d3a-ba95-3aab95a157e0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:56.707277 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-dfdbc336-98f5-44f0-b3f7-f5611ec06153 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26683279-f56e-4f61-8fbb-57f98861675b"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:54:56.708478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-dfdbc336-98f5-44f0-b3f7-f5611ec06153 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:56.715148 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dfdbc336-98f5-44f0-b3f7-f5611ec06153 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:56.715591 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dfdbc336-98f5-44f0-b3f7-f5611ec06153 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:56.716342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dfdbc336-98f5-44f0-b3f7-f5611ec06153 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:56.716792 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dfdbc336-98f5-44f0-b3f7-f5611ec06153 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:56.729797 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2f70b2e2-b7d0-4d3a-ba95-3aab95a157e0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:56.737235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2f70b2e2-b7d0-4d3a-ba95-3aab95a157e0 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1368 microversion: 2.1 time: 0.159979 Jul 20 22:54:56.737804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 377/752] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:56 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:54:57.528947 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-dfdbc336-98f5-44f0-b3f7-f5611ec06153 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825404 Jul 20 22:54:57.529499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 376/753] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:54:56 2022] POST /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:54:57.754570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-69a91e16-680c-4cd3-a9aa-9c4daefb6d67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:57.755463 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-69a91e16-680c-4cd3-a9aa-9c4daefb6d67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:57.763094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-69a91e16-680c-4cd3-a9aa-9c4daefb6d67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:57.763542 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-69a91e16-680c-4cd3-a9aa-9c4daefb6d67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:57.764300 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-69a91e16-680c-4cd3-a9aa-9c4daefb6d67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:57.764730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-69a91e16-680c-4cd3-a9aa-9c4daefb6d67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:57.896778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-69a91e16-680c-4cd3-a9aa-9c4daefb6d67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:57.904821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-69a91e16-680c-4cd3-a9aa-9c4daefb6d67 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1368 microversion: 2.1 time: 0.154144 Jul 20 22:54:57.905399 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 378/754] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:57 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:54:58.275525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-2466c10f-8e66-4dc9-bb7f-ed313220a94f req-3662cece-193c-4f10-a7a0-39485ec19b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a732c09e-e99c-4bac-98ad-00a3a6547cc2", "name": "network-vif-plugged", "status": "completed", "tag": "9c946aca-d30d-47a8-85d4-39572b50ee93"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:54:58.279200 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:58.284898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-2466c10f-8e66-4dc9-bb7f-ed313220a94f req-3662cece-193c-4f10-a7a0-39485ec19b85 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:58.285660 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-2466c10f-8e66-4dc9-bb7f-ed313220a94f req-3662cece-193c-4f10-a7a0-39485ec19b85 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:58.289113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:58.296188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-2466c10f-8e66-4dc9-bb7f-ed313220a94f req-3662cece-193c-4f10-a7a0-39485ec19b85 service nova] Creating event network-vif-plugged:9c946aca-d30d-47a8-85d4-39572b50ee93 for instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 on hv-cinder-79987 Jul 20 22:54:58.300928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-2466c10f-8e66-4dc9-bb7f-ed313220a94f req-3662cece-193c-4f10-a7a0-39485ec19b85 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029977 Jul 20 22:54:58.301553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 377/755] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:54:58.921775 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7aa34b42-6786-4f70-8d67-b039f8e0e6d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:54:58.922397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7aa34b42-6786-4f70-8d67-b039f8e0e6d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:54:58.924273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:58.924946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=6 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:58.930938 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7aa34b42-6786-4f70-8d67-b039f8e0e6d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:58.931424 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7aa34b42-6786-4f70-8d67-b039f8e0e6d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:58.932188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7aa34b42-6786-4f70-8d67-b039f8e0e6d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:54:58.932626 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7aa34b42-6786-4f70-8d67-b039f8e0e6d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:54:59.064071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7aa34b42-6786-4f70-8d67-b039f8e0e6d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:54:59.072552 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7aa34b42-6786-4f70-8d67-b039f8e0e6d3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1368 microversion: 2.1 time: 0.154790 Jul 20 22:54:59.073108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 379/756] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:54:58 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:00.086725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=6 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:00.091645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-91bf3866-2bfa-48ac-a6e3-8272b00adf16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:00.092367 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-91bf3866-2bfa-48ac-a6e3-8272b00adf16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:00.099542 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91bf3866-2bfa-48ac-a6e3-8272b00adf16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:00.099980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91bf3866-2bfa-48ac-a6e3-8272b00adf16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:00.100864 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91bf3866-2bfa-48ac-a6e3-8272b00adf16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:00.101291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91bf3866-2bfa-48ac-a6e3-8272b00adf16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:00.235434 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-91bf3866-2bfa-48ac-a6e3-8272b00adf16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:00.242788 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-91bf3866-2bfa-48ac-a6e3-8272b00adf16 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1368 microversion: 2.1 time: 0.156993 Jul 20 22:55:00.243491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 378/757] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:00 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:01.260097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-dc10c8dd-2c29-4be7-a6c0-ffe500bb84bf tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:01.260694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-dc10c8dd-2c29-4be7-a6c0-ffe500bb84bf tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:01.267124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dc10c8dd-2c29-4be7-a6c0-ffe500bb84bf tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:01.267505 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dc10c8dd-2c29-4be7-a6c0-ffe500bb84bf tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:01.268256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dc10c8dd-2c29-4be7-a6c0-ffe500bb84bf tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:01.268687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dc10c8dd-2c29-4be7-a6c0-ffe500bb84bf tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:01.398707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-dc10c8dd-2c29-4be7-a6c0-ffe500bb84bf tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:01.406727 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-dc10c8dd-2c29-4be7-a6c0-ffe500bb84bf tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1557 microversion: 2.1 time: 0.150857 Jul 20 22:55:01.408415 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 380/758] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:01 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:01.423751 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-07ffe307-53cc-48af-8180-d8e2622e995a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:01.424263 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-07ffe307-53cc-48af-8180-d8e2622e995a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:01.431058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-07ffe307-53cc-48af-8180-d8e2622e995a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:01.431511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-07ffe307-53cc-48af-8180-d8e2622e995a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:01.432271 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-07ffe307-53cc-48af-8180-d8e2622e995a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:01.432709 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-07ffe307-53cc-48af-8180-d8e2622e995a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:01.509936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-07ffe307-53cc-48af-8180-d8e2622e995a tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089621 Jul 20 22:55:01.510516 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 379/759] 10.222.0.81 () {58 vars in 1274 bytes} [Wed Jul 20 22:55:01 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:02.742161 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-ea1dd6ea-88a9-4dbc-823b-c73b04923e3b req-a49a0d71-0ff9-4e09-b0c0-404555fab4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a732c09e-e99c-4bac-98ad-00a3a6547cc2", "tag": "9c946aca-d30d-47a8-85d4-39572b50ee93"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:02.751230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-ea1dd6ea-88a9-4dbc-823b-c73b04923e3b req-a49a0d71-0ff9-4e09-b0c0-404555fab4d8 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:02.751675 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-ea1dd6ea-88a9-4dbc-823b-c73b04923e3b req-a49a0d71-0ff9-4e09-b0c0-404555fab4d8 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:02.763892 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-ea1dd6ea-88a9-4dbc-823b-c73b04923e3b req-a49a0d71-0ff9-4e09-b0c0-404555fab4d8 service nova] Creating event network-changed:9c946aca-d30d-47a8-85d4-39572b50ee93 for instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 on hv-cinder-79987 Jul 20 22:55:02.768917 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-ea1dd6ea-88a9-4dbc-823b-c73b04923e3b req-a49a0d71-0ff9-4e09-b0c0-404555fab4d8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030414 Jul 20 22:55:02.769518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 381/760] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:55:06.087282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e2ad2e52-44ee-4974-a7ee-030012cbc66a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:06.089383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e2ad2e52-44ee-4974-a7ee-030012cbc66a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:06.099081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e2ad2e52-44ee-4974-a7ee-030012cbc66a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:06.099705 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e2ad2e52-44ee-4974-a7ee-030012cbc66a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:06.100866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e2ad2e52-44ee-4974-a7ee-030012cbc66a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:06.101518 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e2ad2e52-44ee-4974-a7ee-030012cbc66a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:06.132282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e2ad2e52-44ee-4974-a7ee-030012cbc66a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051652 Jul 20 22:55:06.132829 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 380/761] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:55:06 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:06.144610 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e3a6ae06-bea5-4f78-9a39-7b3577ef24bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:06.145197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e3a6ae06-bea5-4f78-9a39-7b3577ef24bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:06.152388 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3a6ae06-bea5-4f78-9a39-7b3577ef24bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:06.152840 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3a6ae06-bea5-4f78-9a39-7b3577ef24bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:06.153601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3a6ae06-bea5-4f78-9a39-7b3577ef24bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:06.154036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3a6ae06-bea5-4f78-9a39-7b3577ef24bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:06.180430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:06.184488 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e3a6ae06-bea5-4f78-9a39-7b3577ef24bd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/26683279-f56e-4f61-8fbb-57f98861675b" status: 200 len: 194 microversion: 2.1 time: 0.044721 Jul 20 22:55:06.185084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 382/762] 10.222.0.81 () {58 vars in 1412 bytes} [Wed Jul 20 22:55:06 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/26683279-f56e-4f61-8fbb-57f98861675b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:07.881200 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-00e5003b-e69b-4bb7-b2fb-08cf56637730 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "650814df-ab1a-406d-8150-f34a80439b17"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:07.882300 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-00e5003b-e69b-4bb7-b2fb-08cf56637730 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:07.889172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-00e5003b-e69b-4bb7-b2fb-08cf56637730 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:07.889646 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-00e5003b-e69b-4bb7-b2fb-08cf56637730 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:07.890388 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-00e5003b-e69b-4bb7-b2fb-08cf56637730 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:07.890816 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-00e5003b-e69b-4bb7-b2fb-08cf56637730 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:08.629785 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-00e5003b-e69b-4bb7-b2fb-08cf56637730 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "POST /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752333 Jul 20 22:55:08.630392 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 381/763] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:55:07 2022] POST /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:09.399283 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fb2f14c7-ba65-46f2-81b8-924b880ed430 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:09.399838 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fb2f14c7-ba65-46f2-81b8-924b880ed430 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:09.402479 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:09.407418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb2f14c7-ba65-46f2-81b8-924b880ed430 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:09.407869 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb2f14c7-ba65-46f2-81b8-924b880ed430 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:09.408625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb2f14c7-ba65-46f2-81b8-924b880ed430 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:09.409100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb2f14c7-ba65-46f2-81b8-924b880ed430 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:09.432356 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fb2f14c7-ba65-46f2-81b8-924b880ed430 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/ips" status: 200 len: 151 microversion: 2.20 time: 0.036994 Jul 20 22:55:09.432907 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 383/764] 10.222.0.81 () {60 vars in 1288 bytes} [Wed Jul 20 22:55:09 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:55:11.544739 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c9106a3e-9779-4ff6-8d0b-fb97c6247692 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:11.545350 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c9106a3e-9779-4ff6-8d0b-fb97c6247692 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:11.551613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9106a3e-9779-4ff6-8d0b-fb97c6247692 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:11.552049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9106a3e-9779-4ff6-8d0b-fb97c6247692 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:11.553015 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9106a3e-9779-4ff6-8d0b-fb97c6247692 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:11.553443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c9106a3e-9779-4ff6-8d0b-fb97c6247692 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:11.576298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-c9106a3e-9779-4ff6-8d0b-fb97c6247692 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lazy-loading 'flavor' on Instance uuid 0dca5cf4-1a98-44f6-bcfe-dba13d327330 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:55:12.182009 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c9106a3e-9779-4ff6-8d0b-fb97c6247692 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/action" status: 202 len: 0 microversion: 2.20 time: 0.642376 Jul 20 22:55:12.183136 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 382/765] 10.222.0.81 () {62 vars in 1318 bytes} [Wed Jul 20 22:55:11 2022] POST /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 22:55:12.196860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:12.197480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:12.203800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:12.204253 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:12.205022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:12.205458 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:12.338752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:12.347743 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:12.349234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:12.350378 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-326f9167-8a76-4f77-8ca6-58164f26892e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.163525 Jul 20 22:55:12.350930 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 384/766] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:12 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:13.370183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:13.370904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:13.377196 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:13.377638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:13.378446 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:13.378880 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:13.512283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:13.520236 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:13.521746 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:13.522924 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-064aa76f-ff66-4710-a6aa-1a0dfd25f63b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.157479 Jul 20 22:55:13.523511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 383/767] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:13 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:14.541307 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:14.541826 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:14.548784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:14.549232 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:14.550005 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:14.550439 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:14.678450 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:14.686932 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:14.688450 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:14.689629 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a12f92bb-3e64-4cee-a7df-414df18e4b59 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.152288 Jul 20 22:55:14.690192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 385/768] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:14 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:15.707351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:15.707935 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:15.715036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:15.715480 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:15.716262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:15.716689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:15.846242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:15.854147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:15.856307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:15.857443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1509bc9e-bd57-4997-b9ff-e8c3f6d6ddea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.154047 Jul 20 22:55:15.858003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 384/769] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:15 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:16.876146 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:16.876739 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:16.883075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:16.883793 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:16.884551 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:16.884988 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:17.016999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:17.024944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:17.026434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:17.028129 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b1c0bba4-6918-43fa-b519-1dca978d1cd2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.156016 Jul 20 22:55:17.028678 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 386/770] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:16 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:55:17.197443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-76eb94e7-d54c-406b-9a43-dc87516a94ef tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:17.199103 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-76eb94e7-d54c-406b-9a43-dc87516a94ef tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:17.205525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-76eb94e7-d54c-406b-9a43-dc87516a94ef tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:17.205970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-76eb94e7-d54c-406b-9a43-dc87516a94ef tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:17.206722 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-76eb94e7-d54c-406b-9a43-dc87516a94ef tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:17.207196 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-76eb94e7-d54c-406b-9a43-dc87516a94ef tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:17.235483 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-76eb94e7-d54c-406b-9a43-dc87516a94ef tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041882 Jul 20 22:55:17.236027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 385/771] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:55:17 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:17.373983 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-85814331-dc6e-46e3-869a-b2db63cf22f1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:17.374467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-85814331-dc6e-46e3-869a-b2db63cf22f1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:17.380670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-85814331-dc6e-46e3-869a-b2db63cf22f1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:17.381131 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-85814331-dc6e-46e3-869a-b2db63cf22f1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:17.381912 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-85814331-dc6e-46e3-869a-b2db63cf22f1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:17.382366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-85814331-dc6e-46e3-869a-b2db63cf22f1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:17.411558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-85814331-dc6e-46e3-869a-b2db63cf22f1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/26683279-f56e-4f61-8fbb-57f98861675b" status: 200 len: 194 microversion: 2.1 time: 0.042259 Jul 20 22:55:17.412166 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 387/772] 10.222.0.81 () {58 vars in 1412 bytes} [Wed Jul 20 22:55:17 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/26683279-f56e-4f61-8fbb-57f98861675b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:17.421920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1709b47f-f4af-4f21-9f59-23539bb03dd1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:17.422441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1709b47f-f4af-4f21-9f59-23539bb03dd1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:17.428798 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1709b47f-f4af-4f21-9f59-23539bb03dd1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:17.429269 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1709b47f-f4af-4f21-9f59-23539bb03dd1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:17.430049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1709b47f-f4af-4f21-9f59-23539bb03dd1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:17.430479 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1709b47f-f4af-4f21-9f59-23539bb03dd1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:17.509515 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-1709b47f-f4af-4f21-9f59-23539bb03dd1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lazy-loading 'services' on Instance uuid 91ade60e-70bf-4df4-b465-01bbac79f154 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:55:17.705396 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1709b47f-f4af-4f21-9f59-23539bb03dd1 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/26683279-f56e-4f61-8fbb-57f98861675b" status: 202 len: 0 microversion: 2.1 time: 0.287364 Jul 20 22:55:17.706059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 386/773] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:55:17 2022] DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/26683279-f56e-4f61-8fbb-57f98861675b => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:55:18.045736 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:18.046365 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:18.053607 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:18.054054 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:18.054809 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:18.055271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:18.182783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:18.190763 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:18.192315 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:18.193460 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4cf77995-9ebb-4a69-8807-421e2478ab7f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.151725 Jul 20 22:55:18.194313 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 388/774] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:18 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:19.212665 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:19.219203 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:19.219591 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:19.220033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:19.220785 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:19.221217 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:19.354214 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:19.362644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:19.364193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:19.365350 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b0c5f571-cefd-4516-96ca-5b185362873f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.157362 Jul 20 22:55:19.365902 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 387/775] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:19 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:19.868734 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d665911d-3066-4788-878a-f7b80c007f35 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:19.869264 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d665911d-3066-4788-878a-f7b80c007f35 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:19.876751 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d665911d-3066-4788-878a-f7b80c007f35 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:19.877204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d665911d-3066-4788-878a-f7b80c007f35 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:19.877970 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d665911d-3066-4788-878a-f7b80c007f35 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:19.878408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d665911d-3066-4788-878a-f7b80c007f35 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:19.906401 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d665911d-3066-4788-878a-f7b80c007f35 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/650814df-ab1a-406d-8150-f34a80439b17" status: 200 len: 194 microversion: 2.1 time: 0.041574 Jul 20 22:55:19.906975 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 389/776] 10.222.0.81 () {58 vars in 1412 bytes} [Wed Jul 20 22:55:19 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/650814df-ab1a-406d-8150-f34a80439b17 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:19.917015 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f5a2b722-aaca-4871-8f5d-08c536e675db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:19.922499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f5a2b722-aaca-4871-8f5d-08c536e675db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:19.924603 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f5a2b722-aaca-4871-8f5d-08c536e675db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:19.925038 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f5a2b722-aaca-4871-8f5d-08c536e675db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:19.925782 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f5a2b722-aaca-4871-8f5d-08c536e675db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:19.926248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f5a2b722-aaca-4871-8f5d-08c536e675db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:20.006066 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-f5a2b722-aaca-4871-8f5d-08c536e675db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lazy-loading 'services' on Instance uuid 91ade60e-70bf-4df4-b465-01bbac79f154 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:55:20.242706 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f5a2b722-aaca-4871-8f5d-08c536e675db tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/650814df-ab1a-406d-8150-f34a80439b17" status: 202 len: 0 microversion: 2.1 time: 0.329437 Jul 20 22:55:20.243564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 388/777] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:55:19 2022] DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments/650814df-ab1a-406d-8150-f34a80439b17 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:55:20.384332 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:20.384864 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:20.391510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:20.396878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:20.396878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:20.396878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:20.523541 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:20.531427 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:20.532926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:20.534077 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-94a67faf-10a7-4033-ba9e-4d29aa2d77b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.154039 Jul 20 22:55:20.534636 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 390/778] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:20 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:21.553849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:21.554535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:21.560982 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:21.561417 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:21.562165 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:21.562591 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:21.692122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:21.701019 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:21.703264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:21.704876 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9fc2447a-ef51-4a99-acdb-33b2457c5432 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.156001 Jul 20 22:55:21.705435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 389/779] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:21 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:22.454908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-db03ee8e-7630-4c87-b42e-fc9958966314 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:22.455848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-db03ee8e-7630-4c87-b42e-fc9958966314 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:22.462166 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-db03ee8e-7630-4c87-b42e-fc9958966314 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:22.462600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-db03ee8e-7630-4c87-b42e-fc9958966314 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:22.463413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-db03ee8e-7630-4c87-b42e-fc9958966314 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:22.463839 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-db03ee8e-7630-4c87-b42e-fc9958966314 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:22.492769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-db03ee8e-7630-4c87-b42e-fc9958966314 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041768 Jul 20 22:55:22.493306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 391/780] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:55:22 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:55:22.596334 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a370c761-0edb-4ea8-9c6e-7ed1c101c81d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:22.597302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a370c761-0edb-4ea8-9c6e-7ed1c101c81d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:22.603637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a370c761-0edb-4ea8-9c6e-7ed1c101c81d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:22.604077 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a370c761-0edb-4ea8-9c6e-7ed1c101c81d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:22.604876 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a370c761-0edb-4ea8-9c6e-7ed1c101c81d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:22.605252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a370c761-0edb-4ea8-9c6e-7ed1c101c81d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:22.608338 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:22.634473 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a370c761-0edb-4ea8-9c6e-7ed1c101c81d tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041961 Jul 20 22:55:22.635043 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 390/781] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:55:22 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:55:22.690803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e2e88b61-f7e9-4a14-9cee-e038a44ee49e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:22.691389 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e2e88b61-f7e9-4a14-9cee-e038a44ee49e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:22.697233 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2e88b61-f7e9-4a14-9cee-e038a44ee49e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:22.697673 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2e88b61-f7e9-4a14-9cee-e038a44ee49e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:22.698420 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2e88b61-f7e9-4a14-9cee-e038a44ee49e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:22.698843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2e88b61-f7e9-4a14-9cee-e038a44ee49e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:22.723265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e2e88b61-f7e9-4a14-9cee-e038a44ee49e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:55:22.723456 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:22.724060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:22.730437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:22.730895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:22.731682 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:22.732119 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:22.866320 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:22.875299 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:22.876805 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:22.877962 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8aee1a60-d51d-4aeb-8310-a37ae5bc5f13 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.158822 Jul 20 22:55:22.878521 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 391/782] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:22 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:55:23.031646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e2e88b61-f7e9-4a14-9cee-e038a44ee49e tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 204 len: 0 microversion: 2.1 time: 0.344225 Jul 20 22:55:23.032237 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 392/783] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:55:22 2022] DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:55:23.040292 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4ac73b19-96d4-4a0d-ae21-ec912937ebcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:23.040897 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4ac73b19-96d4-4a0d-ae21-ec912937ebcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:23.046958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4ac73b19-96d4-4a0d-ae21-ec912937ebcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:23.047431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4ac73b19-96d4-4a0d-ae21-ec912937ebcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:23.048178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4ac73b19-96d4-4a0d-ae21-ec912937ebcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:23.048609 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4ac73b19-96d4-4a0d-ae21-ec912937ebcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:23.176638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4ac73b19-96d4-4a0d-ae21-ec912937ebcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:23.184986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4ac73b19-96d4-4a0d-ae21-ec912937ebcd tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1674 microversion: 2.1 time: 0.147877 Jul 20 22:55:23.185608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 392/784] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:23 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:23.896302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:23.897001 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:23.903414 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:23.903858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:23.904608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:23.905042 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:24.038524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:24.046418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:24.047939 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:24.049084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2b4c535c-91b2-415f-86b9-56cb4c3eb106 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.157020 Jul 20 22:55:24.049634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 393/785] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:23 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:24.202611 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8ca55f37-a4d2-4274-bca0-49026ae51fb6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:24.203253 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8ca55f37-a4d2-4274-bca0-49026ae51fb6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:24.209711 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8ca55f37-a4d2-4274-bca0-49026ae51fb6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:24.210154 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8ca55f37-a4d2-4274-bca0-49026ae51fb6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:24.210901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8ca55f37-a4d2-4274-bca0-49026ae51fb6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:24.211359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8ca55f37-a4d2-4274-bca0-49026ae51fb6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:24.341374 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8ca55f37-a4d2-4274-bca0-49026ae51fb6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:24.348761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8ca55f37-a4d2-4274-bca0-49026ae51fb6 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1674 microversion: 2.1 time: 0.151030 Jul 20 22:55:24.349327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 393/786] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:24 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:25.067759 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:25.068343 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:25.074851 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:25.075309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:25.076554 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:25.076994 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:25.268669 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:25.276433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:25.277927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:25.279657 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fb1c201a-9601-486a-b079-884bd8c83480 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1744 microversion: 2.20 time: 0.215825 Jul 20 22:55:25.280212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 394/787] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:25 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1744 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:25.365598 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-52bab797-d37d-4fbe-a929-84915eecc0ee tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:25.366132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-52bab797-d37d-4fbe-a929-84915eecc0ee tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:25.373137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-52bab797-d37d-4fbe-a929-84915eecc0ee tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:25.373585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-52bab797-d37d-4fbe-a929-84915eecc0ee tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:25.374334 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-52bab797-d37d-4fbe-a929-84915eecc0ee tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:25.374774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-52bab797-d37d-4fbe-a929-84915eecc0ee tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:25.651548 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-52bab797-d37d-4fbe-a929-84915eecc0ee tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:25.659116 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-52bab797-d37d-4fbe-a929-84915eecc0ee tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1674 microversion: 2.1 time: 0.297321 Jul 20 22:55:25.659701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 394/788] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:25 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1674 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:26.298535 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:26.299249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:26.305543 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:26.305982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:26.306736 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:26.307206 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:26.420907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-b974d722-6b3a-4bff-a92a-9b00f8e3385e req-67801ab0-1f96-4588-8d6e-8eb5f75a58e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91ade60e-70bf-4df4-b465-01bbac79f154", "name": "network-vif-deleted", "tag": "bf675cfa-21b6-4533-a61f-f27518f53c13"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:26.431446 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-b974d722-6b3a-4bff-a92a-9b00f8e3385e req-67801ab0-1f96-4588-8d6e-8eb5f75a58e6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:26.431888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-b974d722-6b3a-4bff-a92a-9b00f8e3385e req-67801ab0-1f96-4588-8d6e-8eb5f75a58e6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:26.443814 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-b974d722-6b3a-4bff-a92a-9b00f8e3385e req-67801ab0-1f96-4588-8d6e-8eb5f75a58e6 service nova] Creating event network-vif-deleted:bf675cfa-21b6-4533-a61f-f27518f53c13 for instance 91ade60e-70bf-4df4-b465-01bbac79f154 on hv-cinder-79987 Jul 20 22:55:26.450045 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-b974d722-6b3a-4bff-a92a-9b00f8e3385e req-67801ab0-1f96-4588-8d6e-8eb5f75a58e6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032838 Jul 20 22:55:26.451353 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 395/789] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:26.475241 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:26.492707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:26.494429 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:26.495671 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-60a8656b-9dc6-4ff6-a9ac-9b35d67b7fef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1744 microversion: 2.20 time: 0.201868 Jul 20 22:55:26.496234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 395/790] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:26 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:26.676853 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cedd9aa8-2bbb-4049-a138-23da4d0a0f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:26.677500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cedd9aa8-2bbb-4049-a138-23da4d0a0f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:26.684081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cedd9aa8-2bbb-4049-a138-23da4d0a0f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:26.684816 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cedd9aa8-2bbb-4049-a138-23da4d0a0f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:26.686249 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cedd9aa8-2bbb-4049-a138-23da4d0a0f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:26.686854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cedd9aa8-2bbb-4049-a138-23da4d0a0f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:26.754112 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cedd9aa8-2bbb-4049-a138-23da4d0a0f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf649be0c48492f8926f4436cbb3d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90ac023afcb44b5097539298076c0838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:26.762312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cedd9aa8-2bbb-4049-a138-23da4d0a0f9a tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 200 len: 1322 microversion: 2.1 time: 0.089631 Jul 20 22:55:26.762888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 396/791] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:26 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 1322 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:27.514043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:27.514610 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:27.521029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:27.521475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:27.522233 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:27.522663 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:27.670761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:27.670761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:27.671181 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:27.672349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-77aef4ae-f4d1-4b30-8ee2-5ff79bd65963 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1744 microversion: 2.20 time: 0.162358 Jul 20 22:55:27.672915 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 396/792] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:27 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:27.779284 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:27.779838 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:27.786753 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:27.787247 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:27.788007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:27.788443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:27.801498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] HTTP exception thrown: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Request method failure captured: Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 HTTP/1.1 Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWNmy7FE2vyOlDRdFCAoOGsKyn5qkZMxmmeBNge6TOm-mXAvDieQfAARtQ2jSoV_UqcFifd0hQzvBRFkLsa1bdnjB91E2UcGkaNduVPVjeVgQi52pF8ka0f2rDdUH8lY35-KdtE4WFwBgYe1g3juOeuHIdr0VekldXgcnj5bnPKhq0 Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:55:27.803193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_90ac023afcb44b5097539298076c0838", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/90ac023afcb44b5097539298076c0838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 0cf649be0c48492f8926f4436cbb3d6d Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:27.804836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '91ade60e-70bf-4df4-b465-01bbac79f154'} Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:27.805673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:27.807181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:27.808450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Returning 404 to user: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:27.808450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-056af778-0577-405c-b120-6f6a665d7534 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 404 len: 111 microversion: 2.1 time: 0.029231 Jul 20 22:55:27.808450 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 397/793] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:27 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:55:27.814186 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7fe9e9b5-3407-4836-a429-368ac6de24e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '.version_select at 0x7fe243d04d30>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:27.947129 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7fe9e9b5-3407-4836-a429-368ac6de24e9 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513260621" status: 202 len: 0 microversion: 2.1 time: 0.137214 Jul 20 22:55:27.947707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 397/794] 10.222.0.81 () {58 vars in 1220 bytes} [Wed Jul 20 22:55:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513260621 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:55:28.342312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-cd2a3097-a9b1-41ac-85dc-ca187f9fcbdf req-61bc32b5-0996-4b22-bb5e-57a247b6dfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dca5cf4-1a98-44f6-bcfe-dba13d327330", "name": "network-vif-plugged", "status": "completed", "tag": "bc39b14d-82b6-414a-8492-34acd0bf0123"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:28.350644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-cd2a3097-a9b1-41ac-85dc-ca187f9fcbdf req-61bc32b5-0996-4b22-bb5e-57a247b6dfc2 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:28.351123 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-cd2a3097-a9b1-41ac-85dc-ca187f9fcbdf req-61bc32b5-0996-4b22-bb5e-57a247b6dfc2 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:28.363107 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-cd2a3097-a9b1-41ac-85dc-ca187f9fcbdf req-61bc32b5-0996-4b22-bb5e-57a247b6dfc2 service nova] Creating event network-vif-plugged:bc39b14d-82b6-414a-8492-34acd0bf0123 for instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 on hv-cinder-79987 Jul 20 22:55:28.367979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-cd2a3097-a9b1-41ac-85dc-ca187f9fcbdf req-61bc32b5-0996-4b22-bb5e-57a247b6dfc2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030121 Jul 20 22:55:28.368573 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 398/795] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:55:28.691558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:28.692185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:28.698178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:28.698600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:28.699405 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:28.699855 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:28.838520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:28.847473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:28.848986 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:28.850270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e4f91901-3a13-4107-b738-e129d2d489a9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1744 microversion: 2.20 time: 0.163159 Jul 20 22:55:28.850818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 398/796] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:28 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:29.870144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:29.870837 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:29.878195 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:29.878645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:29.879720 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:29.880156 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:30.008994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:30.017807 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:30.019703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:30.020849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a899e552-c4b5-45b8-806d-15fbb65b695d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1744 microversion: 2.20 time: 0.155530 Jul 20 22:55:30.021625 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 399/797] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:29 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:31.039503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:31.040109 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:31.047205 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:31.047650 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:31.048406 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:31.048842 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:31.052938 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:31.180234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:31.188989 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:31.190626 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:31.191807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-38c6865e-a76e-42b3-a7d7-d056f84cf4b3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1744 microversion: 2.20 time: 0.156237 Jul 20 22:55:31.192653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 399/798] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:31 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:31.314029 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:31.314523 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:31.316949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=46 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:31.321732 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:31.322174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:31.322963 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:31.323415 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:31.336500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] HTTP exception thrown: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Request method failure captured: Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 HTTP/1.1 Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWNmy7FE2vyOlDRdFCAoOGsKyn5qkZMxmmeBNge6TOm-mXAvDieQfAARtQ2jSoV_UqcFifd0hQzvBRFkLsa1bdnjB91E2UcGkaNduVPVjeVgQi52pF8ka0f2rDdUH8lY35-KdtE4WFwBgYe1g3juOeuHIdr0VekldXgcnj5bnPKhq0 Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:55:31.338118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_90ac023afcb44b5097539298076c0838", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/90ac023afcb44b5097539298076c0838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 0cf649be0c48492f8926f4436cbb3d6d Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.339649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '91ade60e-70bf-4df4-b465-01bbac79f154'} Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:31.340553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.342108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.343801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Returning 404 to user: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:31.343801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-107f45d9-df77-460b-bb90-623b4d044e85 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 404 len: 111 microversion: 2.1 time: 0.029844 Jul 20 22:55:31.343801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 400/799] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:55:31 2022] DELETE /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:55:31.348710 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:31.349343 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: 91ade60e-70bf-4df4-b465-01bbac79f154] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:31.355809 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:31.356249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:31.358808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:31.358808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:31.371593 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] HTTP exception thrown: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Request method failure captured: Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 HTTP/1.1 Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWNmy7FE2vyOlDRdFCAoOGsKyn5qkZMxmmeBNge6TOm-mXAvDieQfAARtQ2jSoV_UqcFifd0hQzvBRFkLsa1bdnjB91E2UcGkaNduVPVjeVgQi52pF8ka0f2rDdUH8lY35-KdtE4WFwBgYe1g3juOeuHIdr0VekldXgcnj5bnPKhq0 Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:55:31.373995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_90ac023afcb44b5097539298076c0838", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/90ac023afcb44b5097539298076c0838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 0cf649be0c48492f8926f4436cbb3d6d Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.375567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '91ade60e-70bf-4df4-b465-01bbac79f154'} Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:31.376413 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. Jul 20 22:55:31.377818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:31.379046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Returning 404 to user: Instance 91ade60e-70bf-4df4-b465-01bbac79f154 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:31.379046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0a60af7f-9937-48d4-a966-58c86c351dc8 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154" status: 404 len: 111 microversion: 2.1 time: 0.031240 Jul 20 22:55:31.379046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 400/800] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:31 2022] GET /compute/v2.1/servers/91ade60e-70bf-4df4-b465-01bbac79f154 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:55:32.209843 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:32.210835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:32.217333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:32.217774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:32.218520 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:32.218950 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:32.354171 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:32.362138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:32.363656 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:32.364807 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d52d98fb-1197-49ed-80cd-7d301c3829ce tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.159165 Jul 20 22:55:32.365470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 401/801] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:32 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:32.680891 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:32.681383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:32.688391 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:32.688831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:32.689586 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:32.690007 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:32.705264 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] HTTP exception thrown: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Request method failure captured: Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 HTTP/1.1 Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWNmy7FE2vyOlDRdFCAoOGsKyn5qkZMxmmeBNge6TOm-mXAvDieQfAARtQ2jSoV_UqcFifd0hQzvBRFkLsa1bdnjB91E2UcGkaNduVPVjeVgQi52pF8ka0f2rDdUH8lY35-KdtE4WFwBgYe1g3juOeuHIdr0VekldXgcnj5bnPKhq0 Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:55:32.706801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_90ac023afcb44b5097539298076c0838", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/90ac023afcb44b5097539298076c0838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 0cf649be0c48492f8926f4436cbb3d6d Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.708150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'cce8a500-8166-4cb3-bc33-41c35ef48651'} Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:32.708894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.710113 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.711908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Returning 404 to user: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:32.711908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c7cf5316-bee8-41da-b559-c3c787dc585c tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 404 len: 111 microversion: 2.1 time: 0.031165 Jul 20 22:55:32.711908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 401/802] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:55:32 2022] DELETE /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:55:32.717015 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:32.717636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] [instance: cce8a500-8166-4cb3-bc33-41c35ef48651] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:32.723722 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:32.724174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:32.724948 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:32.725444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:32.739484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] HTTP exception thrown: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Request method failure captured: Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 HTTP/1.1 Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWNmy7FE2vyOlDRdFCAoOGsKyn5qkZMxmmeBNge6TOm-mXAvDieQfAARtQ2jSoV_UqcFifd0hQzvBRFkLsa1bdnjB91E2UcGkaNduVPVjeVgQi52pF8ka0f2rDdUH8lY35-KdtE4WFwBgYe1g3juOeuHIdr0VekldXgcnj5bnPKhq0 Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:55:32.741137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_90ac023afcb44b5097539298076c0838", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/90ac023afcb44b5097539298076c0838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/90ac023afcb44b5097539298076c0838"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 90ac023afcb44b5097539298076c0838 Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeTestJSON-638484999 Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 0cf649be0c48492f8926f4436cbb3d6d Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeTestJSON-638484999-project Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.742613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'cce8a500-8166-4cb3-bc33-41c35ef48651'} Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:32.744582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. Jul 20 22:55:32.746558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:55:32.748866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] Returning 404 to user: Instance cce8a500-8166-4cb3-bc33-41c35ef48651 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:32.748866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d1c660b0-84d7-4b17-9c4c-6f4bf09f7244 tempest-AttachVolumeTestJSON-638484999 tempest-AttachVolumeTestJSON-638484999-project] 10.222.0.81 "GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651" status: 404 len: 111 microversion: 2.1 time: 0.029433 Jul 20 22:55:32.748866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 402/803] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:32 2022] GET /compute/v2.1/servers/cce8a500-8166-4cb3-bc33-41c35ef48651 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:55:33.385128 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:33.385755 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:33.393475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:33.393926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:33.394698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:33.395163 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:33.727262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:33.727262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:33.727977 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:33.727977 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b7b521c4-c4d2-4a92-9395-a98f451db606 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.339135 Jul 20 22:55:33.727977 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 402/804] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:33 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:34.744737 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:34.746554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:34.753265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:34.753874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:34.754804 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:34.755490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:34.913977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:34.923787 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:34.925481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:34.926872 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-48fa7a4b-9db0-4ef6-86df-2ebb1a0f9d1b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.186146 Jul 20 22:55:34.928327 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 403/805] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:34 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:35.945981 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:35.946918 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:35.955809 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:35.956352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:35.957133 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:35.957618 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:36.086461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:36.094805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:36.096335 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:36.097473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-56820ae0-a67b-4190-80dd-6200eb26e079 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.155882 Jul 20 22:55:36.098024 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 403/806] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:35 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:37.115552 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:37.116158 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:37.127319 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:37.127766 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:37.128550 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:37.128991 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:37.339712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:37.349863 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:37.351757 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:37.353120 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3fb878d5-6c3c-46f2-86f8-e785c030adf2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.241442 Jul 20 22:55:37.354148 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 404/807] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:37 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:38.381064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:38.382294 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:38.391730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:38.392546 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:38.393923 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:38.394520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:38.569466 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:38.579762 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:38.579762 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:38.580656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2e7a1164-0b76-4565-b196-8d37eb5493d0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.205348 Jul 20 22:55:38.581244 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 404/808] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:38 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:39.599620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:39.600232 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:39.619064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:39.619064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:39.619064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:39.619064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:39.751484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:39.759692 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:39.761195 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:39.762344 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fc92c591-60c0-4645-8790-43d4cb4b3de6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.166796 Jul 20 22:55:39.762898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 405/809] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:39 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:40.753269 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1aa9bc46-6172-4b22-a0d8-6022d328eff2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Action: 'create', calling method: .version_select at 0x7fe243d6a5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-612240360", "metadata": {"Type": "work"}}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1aa9bc46-6172-4b22-a0d8-6022d328eff2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Request method failure captured: Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 121 Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IfsKWDYN50JYD92QEi7P0gFd4HAxhmL3kOn4RTyvsN1LF1tnRUOGwEYurnaeQRBg62Au5pw9DwTtOoy03-276ZeV4ro_LnpTFIulZ_7o2xjq_nAG27DdGFcukEyQQp5Ii3v5kFQNMzqIvYfIKLcwl9_ky-HL8d1R4jRPIhjeJEz-kw Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:55:40.780153 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be2475b9385d4c9c9377cec5b1c18c22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: af8afe42fff94ce69070530e4032d3e0 Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-612240360", "metadata": {"Type": "work"}}} Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: Jul 20 22:55:40.781652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-612240360', 'metadata': {'Type': 'work'}}}} Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise error Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:40.782520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 22:55:40.783995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 22:55:40.785158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 22:55:40.785158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.785313 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:40.785767 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:40.787545 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1aa9bc46-6172-4b22-a0d8-6022d328eff2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:40.788642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1aa9bc46-6172-4b22-a0d8-6022d328eff2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.166148 Jul 20 22:55:40.789553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 405/810] 10.222.0.81 () {60 vars in 1155 bytes} [Wed Jul 20 22:55:40 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 22:55:40.792812 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:40.793594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:40.794557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:40.795486 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:40.800408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-eeb13241-e70a-4cd9-899e-559bed7ec496 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Action: 'create', calling method: .version_select at 0x7fe243d95040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1355367209", "metadata": {"Type": "work"}}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-eeb13241-e70a-4cd9-899e-559bed7ec496 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Request method failure captured: Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 120 Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IfsKWDYN50JYD92QEi7P0gFd4HAxhmL3kOn4RTyvsN1LF1tnRUOGwEYurnaeQRBg62Au5pw9DwTtOoy03-276ZeV4ro_LnpTFIulZ_7o2xjq_nAG27DdGFcukEyQQp5Ii3v5kFQNMzqIvYfIKLcwl9_ky-HL8d1R4jRPIhjeJEz-kw Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:55:40.802894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be2475b9385d4c9c9377cec5b1c18c22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: af8afe42fff94ce69070530e4032d3e0 Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1355367209", "metadata": {"Type": "work"}}} Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: Jul 20 22:55:40.804598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1355367209', 'metadata': {'Type': 'work'}}}} Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise error Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi '0' Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:40.805583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 22:55:40.807214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 22:55:40.808429 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 22:55:40.808429 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.810530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-eeb13241-e70a-4cd9-899e-559bed7ec496 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:40.817114 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-eeb13241-e70a-4cd9-899e-559bed7ec496 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020647 Jul 20 22:55:40.818158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 406/811] 10.222.0.81 () {60 vars in 1155 bytes} [Wed Jul 20 22:55:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 22:55:40.830302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3bef8008-b5c7-4256-b068-38931af11a36 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Action: 'create', calling method: .version_select at 0x7fe243d2f940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1135309976", "metadata": {"Type": "work"}}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3bef8008-b5c7-4256-b068-38931af11a36 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Request method failure captured: Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 119 Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IfsKWDYN50JYD92QEi7P0gFd4HAxhmL3kOn4RTyvsN1LF1tnRUOGwEYurnaeQRBg62Au5pw9DwTtOoy03-276ZeV4ro_LnpTFIulZ_7o2xjq_nAG27DdGFcukEyQQp5Ii3v5kFQNMzqIvYfIKLcwl9_ky-HL8d1R4jRPIhjeJEz-kw Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:55:40.832661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be2475b9385d4c9c9377cec5b1c18c22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: af8afe42fff94ce69070530e4032d3e0 Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1135309976", "metadata": {"Type": "work"}}} Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: Jul 20 22:55:40.834035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1135309976', 'metadata': {'Type': 'work'}}}} Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise error Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi '' Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:40.834861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 22:55:40.836623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 22:55:40.837820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 22:55:40.837820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.837820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3bef8008-b5c7-4256-b068-38931af11a36 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:40.837820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3bef8008-b5c7-4256-b068-38931af11a36 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008867 Jul 20 22:55:40.839304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 407/812] 10.222.0.81 () {60 vars in 1155 bytes} [Wed Jul 20 22:55:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:55:40.845052 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d5ca6635-93e3-46e7-b9b7-f19c8b3a90f5 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Calling method '.version_select at 0x7fe243d044c0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:40.880063 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-d5ca6635-93e3-46e7-b9b7-f19c8b3a90f5 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] HTTP exception thrown: Volume tempest-invalid-1753580067 could not be found. Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d5ca6635-93e3-46e7-b9b7-f19c8b3a90f5 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Request method failure captured: Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1753580067 HTTP/1.1 Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IfsKWDYN50JYD92QEi7P0gFd4HAxhmL3kOn4RTyvsN1LF1tnRUOGwEYurnaeQRBg62Au5pw9DwTtOoy03-276ZeV4ro_LnpTFIulZ_7o2xjq_nAG27DdGFcukEyQQp5Ii3v5kFQNMzqIvYfIKLcwl9_ky-HL8d1R4jRPIhjeJEz-kw Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:55:40.882373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be2475b9385d4c9c9377cec5b1c18c22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: af8afe42fff94ce69070530e4032d3e0 Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Volume tempest-invalid-1753580067 could not be found. Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'tempest-invalid-1753580067'} Jul 20 22:55:40.884228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1753580067 could not be found. (HTTP 404) (Request-ID: req-c65f2237-7d05-420b-90c0-5c7adb97f0e3) Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.885221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:55:40.886625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1753580067 could not be found. Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:55:40.888557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1753580067 could not be found. Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1753580067 could not be found. Jul 20 22:55:40.890286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.893280 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d5ca6635-93e3-46e7-b9b7-f19c8b3a90f5 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Returning 404 to user: Volume tempest-invalid-1753580067 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:40.893280 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d5ca6635-93e3-46e7-b9b7-f19c8b3a90f5 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1753580067" status: 404 len: 99 microversion: 2.1 time: 0.052469 Jul 20 22:55:40.893280 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 408/813] 10.222.0.81 () {58 vars in 1217 bytes} [Wed Jul 20 22:55:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1753580067 => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 22:55:40.904565 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ebfb7b41-a572-4432-9488-c504abe40db1 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004364 Jul 20 22:55:40.905331 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 409/814] 10.222.0.81 () {58 vars in 1139 bytes} [Wed Jul 20 22:55:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 22:55:40.914633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-aaeaf65b-5b5d-43af-adf5-c1beeab58efa tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003662 Jul 20 22:55:40.915181 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 410/815] 10.222.0.81 () {58 vars in 1136 bytes} [Wed Jul 20 22:55:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 22:55:40.923679 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d0c28a39-5406-41f9-b6d0-e332632c30a2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Calling method '.version_select at 0x7fe243d951f0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:40.953730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-d0c28a39-5406-41f9-b6d0-e332632c30a2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] HTTP exception thrown: Volume 1c0fb348-0a7a-4301-ac6d-84bdca363aed could not be found. Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d0c28a39-5406-41f9-b6d0-e332632c30a2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Request method failure captured: Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/os-volumes/1c0fb348-0a7a-4301-ac6d-84bdca363aed HTTP/1.1 Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IfsKWDYN50JYD92QEi7P0gFd4HAxhmL3kOn4RTyvsN1LF1tnRUOGwEYurnaeQRBg62Au5pw9DwTtOoy03-276ZeV4ro_LnpTFIulZ_7o2xjq_nAG27DdGFcukEyQQp5Ii3v5kFQNMzqIvYfIKLcwl9_ky-HL8d1R4jRPIhjeJEz-kw Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:55:40.955689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be2475b9385d4c9c9377cec5b1c18c22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: af8afe42fff94ce69070530e4032d3e0 Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Volume 1c0fb348-0a7a-4301-ac6d-84bdca363aed could not be found. Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '1c0fb348-0a7a-4301-ac6d-84bdca363aed'} Jul 20 22:55:40.957010 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1c0fb348-0a7a-4301-ac6d-84bdca363aed could not be found. (HTTP 404) (Request-ID: req-7888dbf9-b7bf-4a07-a05d-07334028e754) Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.957913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 22:55:40.959127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1c0fb348-0a7a-4301-ac6d-84bdca363aed could not be found. Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 22:55:40.960369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1c0fb348-0a7a-4301-ac6d-84bdca363aed could not be found. Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1c0fb348-0a7a-4301-ac6d-84bdca363aed could not be found. Jul 20 22:55:40.961583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:40.965259 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d0c28a39-5406-41f9-b6d0-e332632c30a2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Returning 404 to user: Volume 1c0fb348-0a7a-4301-ac6d-84bdca363aed could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:40.965259 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d0c28a39-5406-41f9-b6d0-e332632c30a2 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/1c0fb348-0a7a-4301-ac6d-84bdca363aed" status: 404 len: 109 microversion: 2.1 time: 0.044693 Jul 20 22:55:40.965259 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 411/816] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:55:40 2022] DELETE /compute/v2.1/os-volumes/1c0fb348-0a7a-4301-ac6d-84bdca363aed => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:55:40.972460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:40.975896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9979bc2b-e19e-46d5-9db6-c7cc0b2825c1 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Calling method '.version_select at 0x7fe243d6a310>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:40.982458 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:40.985587 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:40.986907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-633020e6-df92-47cf-9f1c-335de92454b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.209770 Jul 20 22:55:40.991061 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 406/817] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:40 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:55:41.012430 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-9979bc2b-e19e-46d5-9db6-c7cc0b2825c1 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] HTTP exception thrown: Volume f2b819af-499b-4c07-a201-647deffd1c77 could not be found. Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9979bc2b-e19e-46d5-9db6-c7cc0b2825c1 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Request method failure captured: Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/os-volumes/f2b819af-499b-4c07-a201-647deffd1c77 HTTP/1.1 Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IfsKWDYN50JYD92QEi7P0gFd4HAxhmL3kOn4RTyvsN1LF1tnRUOGwEYurnaeQRBg62Au5pw9DwTtOoy03-276ZeV4ro_LnpTFIulZ_7o2xjq_nAG27DdGFcukEyQQp5Ii3v5kFQNMzqIvYfIKLcwl9_ky-HL8d1R4jRPIhjeJEz-kw Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:55:41.015255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_be2475b9385d4c9c9377cec5b1c18c22", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/be2475b9385d4c9c9377cec5b1c18c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: be2475b9385d4c9c9377cec5b1c18c22 Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesNegativeTest-839066199 Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: af8afe42fff94ce69070530e4032d3e0 Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesNegativeTest-839066199-project Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Volume f2b819af-499b-4c07-a201-647deffd1c77 could not be found. Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'f2b819af-499b-4c07-a201-647deffd1c77'} Jul 20 22:55:41.016955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f2b819af-499b-4c07-a201-647deffd1c77 could not be found. (HTTP 404) (Request-ID: req-4360dfc4-5cee-4442-85d8-d5822ccbd311) Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:41.017898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 22:55:41.021428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f2b819af-499b-4c07-a201-647deffd1c77 could not be found. Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 22:55:41.023336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f2b819af-499b-4c07-a201-647deffd1c77 could not be found. Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f2b819af-499b-4c07-a201-647deffd1c77 could not be found. Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9979bc2b-e19e-46d5-9db6-c7cc0b2825c1 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] Returning 404 to user: Volume f2b819af-499b-4c07-a201-647deffd1c77 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9979bc2b-e19e-46d5-9db6-c7cc0b2825c1 tempest-VolumesNegativeTest-839066199 tempest-VolumesNegativeTest-839066199-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f2b819af-499b-4c07-a201-647deffd1c77" status: 404 len: 109 microversion: 2.1 time: 0.045081 Jul 20 22:55:41.026436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 412/818] 10.222.0.81 () {58 vars in 1244 bytes} [Wed Jul 20 22:55:40 2022] GET /compute/v2.1/os-volumes/f2b819af-499b-4c07-a201-647deffd1c77 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:55:42.005745 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:42.006315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:42.014609 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:42.015076 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:42.016069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:42.016907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:42.197027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:42.207924 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:42.209608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:42.210770 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a3b0b166-a069-42d3-b13b-0db6d2a0c52b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.209138 Jul 20 22:55:42.211359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 407/819] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:42 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:43.229697 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:43.230303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:43.232765 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:43.237548 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:43.237994 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:43.238756 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:43.239218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:43.373597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:43.382011 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:43.383543 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:43.384960 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ffbe4179-fe72-45c6-b292-e44091007f50 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.159892 Jul 20 22:55:43.385695 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 413/820] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:43 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:44.405445 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:44.406622 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:44.413488 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:44.413905 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:44.414887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:44.415443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:44.548312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:44.556342 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:44.557847 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:44.559000 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d60144e7-cc65-4ed8-b71b-6eb06f1c8e2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.158475 Jul 20 22:55:44.559577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 408/821] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:44 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:45.530714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 22:55:45.531402 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 22:55:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 22:55:45.577900 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:45.578543 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:45.585246 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:45.585696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:45.586455 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:45.586891 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:45.720806 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:45.728757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:45.730235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:45.731394 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-833926b5-399c-4c78-bbaa-48bdbe6c2228 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1739 microversion: 2.20 time: 0.157699 Jul 20 22:55:45.731975 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 414/822] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:45 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:46.750278 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:46.750875 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:46.757534 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:46.757994 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:46.758842 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:46.759573 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:46.888876 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:46.897518 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:46.899129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:46.900373 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a516d194-8cee-46cb-9a2f-4306ccb1296f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1721 microversion: 2.20 time: 0.154470 Jul 20 22:55:46.900777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 409/823] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:46 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:47.919165 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:47.920294 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:47.926705 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:47.927195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:47.927983 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:47.928416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:48.070175 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:48.078407 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:48.080061 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:48.081312 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1405567d-666a-4e0d-8ec3-8117ba8d3a6f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1721 microversion: 2.20 time: 0.166247 Jul 20 22:55:48.081892 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 415/824] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:47 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:48.456361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-18b07ed4-8d51-4c03-9a16-c514b1513f3d req-a7725316-f4b9-41de-a766-89748bada1ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dca5cf4-1a98-44f6-bcfe-dba13d327330", "name": "network-vif-unplugged", "status": "completed", "tag": "bc39b14d-82b6-414a-8492-34acd0bf0123"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:48.467871 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-18b07ed4-8d51-4c03-9a16-c514b1513f3d req-a7725316-f4b9-41de-a766-89748bada1ad service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:48.468337 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-18b07ed4-8d51-4c03-9a16-c514b1513f3d req-a7725316-f4b9-41de-a766-89748bada1ad service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:48.473085 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:48.480239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-18b07ed4-8d51-4c03-9a16-c514b1513f3d req-a7725316-f4b9-41de-a766-89748bada1ad service nova] Creating event network-vif-unplugged:bc39b14d-82b6-414a-8492-34acd0bf0123 for instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 on hv-cinder-79987 Jul 20 22:55:48.485230 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-18b07ed4-8d51-4c03-9a16-c514b1513f3d req-a7725316-f4b9-41de-a766-89748bada1ad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033330 Jul 20 22:55:48.485810 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 410/825] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:55:49.101263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:49.101877 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:49.108641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:49.109116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:49.109878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:49.110308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:49.239679 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:49.247449 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:49.248925 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:49.250052 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-51e37d9e-67fb-470b-b5d6-e702d516b61d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1664 microversion: 2.20 time: 0.152703 Jul 20 22:55:49.250601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 416/826] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:49 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1664 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:49.269021 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b0699cb2-ca37-4d38-97c3-3810cd674c3f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b6c5949-ca4e-48b7-8de1-2106ede3ee2a"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:49.270161 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b0699cb2-ca37-4d38-97c3-3810cd674c3f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:49.276479 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b0699cb2-ca37-4d38-97c3-3810cd674c3f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:49.276929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b0699cb2-ca37-4d38-97c3-3810cd674c3f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:49.277684 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b0699cb2-ca37-4d38-97c3-3810cd674c3f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:49.278119 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b0699cb2-ca37-4d38-97c3-3810cd674c3f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:50.397400 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b0699cb2-ca37-4d38-97c3-3810cd674c3f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.133079 Jul 20 22:55:50.398022 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 411/827] 10.222.0.81 () {62 vars in 1363 bytes} [Wed Jul 20 22:55:49 2022] POST /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments => generated 188 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:55:50.514508 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8e95141a-82ff-485c-b6c0-fc04fe4e7892 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:50.515093 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8e95141a-82ff-485c-b6c0-fc04fe4e7892 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:50.521453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8e95141a-82ff-485c-b6c0-fc04fe4e7892 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:50.521972 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8e95141a-82ff-485c-b6c0-fc04fe4e7892 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:50.522715 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8e95141a-82ff-485c-b6c0-fc04fe4e7892 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:50.523180 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8e95141a-82ff-485c-b6c0-fc04fe4e7892 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:50.735795 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8e95141a-82ff-485c-b6c0-fc04fe4e7892 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/action" status: 202 len: 0 microversion: 2.20 time: 0.225690 Jul 20 22:55:50.736409 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 417/828] 10.222.0.81 () {62 vars in 1318 bytes} [Wed Jul 20 22:55:50 2022] POST /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:55:50.744511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:50.745120 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:50.752858 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:50.753307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:50.754069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:50.754502 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:50.894387 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:50.902710 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:50.904224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:50.905365 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fa3dabe5-72f9-4d88-baf8-901836d48815 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1750 microversion: 2.20 time: 0.164760 Jul 20 22:55:50.905914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 412/829] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:50 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:51.062559 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f154eb07-dca7-45c8-8397-4152a8a7c999 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:55:51.063119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f154eb07-dca7-45c8-8397-4152a8a7c999 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:51.069207 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f154eb07-dca7-45c8-8397-4152a8a7c999 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:51.069649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f154eb07-dca7-45c8-8397-4152a8a7c999 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:51.070400 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f154eb07-dca7-45c8-8397-4152a8a7c999 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:51.070825 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f154eb07-dca7-45c8-8397-4152a8a7c999 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:51.094800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-f154eb07-dca7-45c8-8397-4152a8a7c999 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lazy-loading 'flavor' on Instance uuid 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:55:51.374369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f154eb07-dca7-45c8-8397-4152a8a7c999 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "POST /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7/action" status: 202 len: 0 microversion: 2.1 time: 0.315613 Jul 20 22:55:51.374962 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 418/830] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:55:51 2022] POST /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:55:51.383102 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f8e33bf4-3bc2-4868-9263-f8e29868fa20 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:51.383855 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f8e33bf4-3bc2-4868-9263-f8e29868fa20 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:51.391144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f8e33bf4-3bc2-4868-9263-f8e29868fa20 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:51.391674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f8e33bf4-3bc2-4868-9263-f8e29868fa20 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:51.392496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f8e33bf4-3bc2-4868-9263-f8e29868fa20 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:51.392983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f8e33bf4-3bc2-4868-9263-f8e29868fa20 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:51.567659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f8e33bf4-3bc2-4868-9263-f8e29868fa20 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:51.575426 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f8e33bf4-3bc2-4868-9263-f8e29868fa20 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.196063 Jul 20 22:55:51.576571 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 413/831] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:51 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:55:51.925330 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:51.926057 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:51.932365 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:51.932813 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:51.933599 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:51.934032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:52.064663 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:52.073376 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:52.074867 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:52.076045 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-09baaabf-5384-46bf-be9c-aeb60fb6e3c7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1750 microversion: 2.20 time: 0.155447 Jul 20 22:55:52.076613 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 419/832] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:51 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:52.594020 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6904a917-790b-4620-9197-7c014431cbd0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:52.594625 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6904a917-790b-4620-9197-7c014431cbd0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:52.601008 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6904a917-790b-4620-9197-7c014431cbd0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:52.601445 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6904a917-790b-4620-9197-7c014431cbd0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:52.602186 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6904a917-790b-4620-9197-7c014431cbd0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:52.602619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6904a917-790b-4620-9197-7c014431cbd0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:52.729969 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6904a917-790b-4620-9197-7c014431cbd0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:52.738437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6904a917-790b-4620-9197-7c014431cbd0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.148971 Jul 20 22:55:52.738995 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 414/833] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:52 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:53.093640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:53.094236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:53.100600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:53.101041 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:53.101800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:53.102230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:53.240355 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:53.249704 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:53.253764 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:53.253764 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-65aad9ef-8604-4cae-9581-6617490cd8ae tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1752 microversion: 2.20 time: 0.162669 Jul 20 22:55:53.253764 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 420/834] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:53 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:53.756190 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0eb11033-198e-4bc9-afed-5e8bb2d198bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:53.756712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0eb11033-198e-4bc9-afed-5e8bb2d198bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:53.763554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0eb11033-198e-4bc9-afed-5e8bb2d198bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:53.764003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0eb11033-198e-4bc9-afed-5e8bb2d198bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:53.764759 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0eb11033-198e-4bc9-afed-5e8bb2d198bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:53.765197 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0eb11033-198e-4bc9-afed-5e8bb2d198bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:53.902769 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0eb11033-198e-4bc9-afed-5e8bb2d198bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:53.911094 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0eb11033-198e-4bc9-afed-5e8bb2d198bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.158853 Jul 20 22:55:53.911660 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 415/835] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:53 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:54.270293 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:54.270906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:54.277488 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:54.277946 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:54.278712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:54.279774 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:54.410323 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:54.419202 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:54.420720 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:54.421966 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d2a8e67e-07aa-40e5-9bef-f002ed064514 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1752 microversion: 2.20 time: 0.155380 Jul 20 22:55:54.422510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 421/836] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:54 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:54.928099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-de50a0cd-cd59-4ecf-8174-54a8b4797d68 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:54.928658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-de50a0cd-cd59-4ecf-8174-54a8b4797d68 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:54.935675 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de50a0cd-cd59-4ecf-8174-54a8b4797d68 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:54.936135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de50a0cd-cd59-4ecf-8174-54a8b4797d68 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:54.936889 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de50a0cd-cd59-4ecf-8174-54a8b4797d68 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:54.937385 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de50a0cd-cd59-4ecf-8174-54a8b4797d68 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:55.071305 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-de50a0cd-cd59-4ecf-8174-54a8b4797d68 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:55.079101 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-de50a0cd-cd59-4ecf-8174-54a8b4797d68 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.155258 Jul 20 22:55:55.079666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 416/837] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:54 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:55:55.443673 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:55.444309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:55.450872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:55.451286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:55.452062 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:55.452505 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:55.456720 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:55.586906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:55.595634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:55.597116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:55.598268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2593cf57-2c71-46f5-a1d9-ad3457956c7b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.158561 Jul 20 22:55:55.598853 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 422/838] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:55 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:56.095769 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6df277bb-acf0-40fd-95ed-4fa8dd3bc645 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:56.096382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6df277bb-acf0-40fd-95ed-4fa8dd3bc645 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:56.102794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6df277bb-acf0-40fd-95ed-4fa8dd3bc645 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:56.103280 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6df277bb-acf0-40fd-95ed-4fa8dd3bc645 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:56.104043 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6df277bb-acf0-40fd-95ed-4fa8dd3bc645 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:56.104472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6df277bb-acf0-40fd-95ed-4fa8dd3bc645 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:56.253257 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6df277bb-acf0-40fd-95ed-4fa8dd3bc645 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:56.261454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6df277bb-acf0-40fd-95ed-4fa8dd3bc645 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.169322 Jul 20 22:55:56.262011 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 417/839] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:56 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:56.618352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:56.619107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:56.626909 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:56.627435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:56.631341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:56.631341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:56.772866 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:56.783280 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:56.785177 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:56.786606 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f1f1965b-96c9-4965-b956-bf95a2e217e2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.172931 Jul 20 22:55:56.787433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 423/840] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:56 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:57.279913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e0c6f11c-1486-498f-8613-bce81bae72fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:57.280517 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e0c6f11c-1486-498f-8613-bce81bae72fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:57.286632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e0c6f11c-1486-498f-8613-bce81bae72fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:57.287118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e0c6f11c-1486-498f-8613-bce81bae72fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:57.287880 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e0c6f11c-1486-498f-8613-bce81bae72fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:57.288311 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e0c6f11c-1486-498f-8613-bce81bae72fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:57.441128 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e0c6f11c-1486-498f-8613-bce81bae72fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:57.453510 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e0c6f11c-1486-498f-8613-bce81bae72fe tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.175725 Jul 20 22:55:57.453510 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 418/841] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:57 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:57.804955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:57.805563 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:57.812576 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:57.814690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:57.814690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:57.814690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:57.974108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:57.993712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:57.995240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:57.996397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7d027c37-5a77-48ff-80b2-c2bcf3657b46 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.195727 Jul 20 22:55:57.996962 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 424/842] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:57 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:58.469251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7d82716b-f3d3-496f-be1a-da1be64a1461 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:58.469945 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7d82716b-f3d3-496f-be1a-da1be64a1461 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:58.477122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7d82716b-f3d3-496f-be1a-da1be64a1461 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:58.477491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7d82716b-f3d3-496f-be1a-da1be64a1461 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:58.478335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7d82716b-f3d3-496f-be1a-da1be64a1461 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:58.478799 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7d82716b-f3d3-496f-be1a-da1be64a1461 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:58.626058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7d82716b-f3d3-496f-be1a-da1be64a1461 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:58.634001 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7d82716b-f3d3-496f-be1a-da1be64a1461 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.169044 Jul 20 22:55:58.634836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 419/843] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:58 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:55:59.020642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:59.020642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:59.025699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:59.026152 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:59.027204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:59.027621 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:59.187303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:59.197825 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:59.199732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:59.201188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a6dfcc3a-a2c5-4da8-83c4-e5384fe20e2c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.188419 Jul 20 22:55:59.219211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 425/844] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:55:59 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:55:59.651949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4db24a9a-bb02-4283-9365-1d4912812f0f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:55:59.652594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4db24a9a-bb02-4283-9365-1d4912812f0f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:55:59.671280 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4db24a9a-bb02-4283-9365-1d4912812f0f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:59.671733 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4db24a9a-bb02-4283-9365-1d4912812f0f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:59.672525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4db24a9a-bb02-4283-9365-1d4912812f0f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:55:59.672938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4db24a9a-bb02-4283-9365-1d4912812f0f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:55:59.845187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4db24a9a-bb02-4283-9365-1d4912812f0f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:55:59.865558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4db24a9a-bb02-4283-9365-1d4912812f0f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.217518 Jul 20 22:55:59.866142 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 420/845] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:55:59 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:00.221670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:00.222477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:00.229427 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:00.230206 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:00.231163 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:00.231829 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:00.385031 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:00.395086 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:00.400584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:00.400584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-10a5655b-4fdd-4f1a-b554-2cffe0ee7416 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.182447 Jul 20 22:56:00.400584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 426/846] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:00 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:00.883733 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-56b537ec-e986-4bf3-99a8-a065ae913650 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:00.884795 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-56b537ec-e986-4bf3-99a8-a065ae913650 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:00.891479 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-56b537ec-e986-4bf3-99a8-a065ae913650 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:00.891858 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-56b537ec-e986-4bf3-99a8-a065ae913650 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:00.893028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-56b537ec-e986-4bf3-99a8-a065ae913650 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:00.894054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-56b537ec-e986-4bf3-99a8-a065ae913650 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:01.038736 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-56b537ec-e986-4bf3-99a8-a065ae913650 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:01.047329 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-56b537ec-e986-4bf3-99a8-a065ae913650 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.167453 Jul 20 22:56:01.048229 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 421/847] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:00 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:01.421001 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:01.421846 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:01.432739 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:01.433470 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:01.434565 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:01.435218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:01.594230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:01.603769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:01.605266 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:01.606438 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5dc7a7c3-3b58-4eb6-b1ad-aef5a3c69b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.193676 Jul 20 22:56:01.621147 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 427/848] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:01 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:02.066728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c79acd8b-3866-48ff-8ae0-22f16a647a13 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:02.068143 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c79acd8b-3866-48ff-8ae0-22f16a647a13 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:02.074764 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c79acd8b-3866-48ff-8ae0-22f16a647a13 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:02.075313 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c79acd8b-3866-48ff-8ae0-22f16a647a13 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:02.076978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c79acd8b-3866-48ff-8ae0-22f16a647a13 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:02.077593 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c79acd8b-3866-48ff-8ae0-22f16a647a13 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:02.247517 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c79acd8b-3866-48ff-8ae0-22f16a647a13 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:02.259889 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c79acd8b-3866-48ff-8ae0-22f16a647a13 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.197145 Jul 20 22:56:02.260970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 422/849] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:02 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:02.626665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:02.627333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:02.642296 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:02.642952 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:02.643972 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:02.644410 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:02.824924 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:02.833479 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:02.834979 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:02.837798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-73ae936b-cf3e-466f-b745-848223e6d3a8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.214501 Jul 20 22:56:02.837798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 428/850] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:02 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:03.278683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e0d98593-513e-435e-bc74-f2e1d04b5160 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:03.280577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e0d98593-513e-435e-bc74-f2e1d04b5160 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:03.282647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=46 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:03.288218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e0d98593-513e-435e-bc74-f2e1d04b5160 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:03.288781 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e0d98593-513e-435e-bc74-f2e1d04b5160 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:03.289749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e0d98593-513e-435e-bc74-f2e1d04b5160 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:03.290214 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e0d98593-513e-435e-bc74-f2e1d04b5160 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:03.438791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e0d98593-513e-435e-bc74-f2e1d04b5160 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:03.446708 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e0d98593-513e-435e-bc74-f2e1d04b5160 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.172000 Jul 20 22:56:03.449586 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 423/851] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:03 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:03.855353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:03.855974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:03.863379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:03.863821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:03.864590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:03.865139 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:04.011500 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:04.020602 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:04.026876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:04.026876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8a0c9c84-4e81-4c45-a262-2d11340f7171 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.171743 Jul 20 22:56:04.026876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 429/852] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:03 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:04.464826 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3fc24eeb-cd85-4d8d-b9f2-36c13c931825 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:04.466747 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3fc24eeb-cd85-4d8d-b9f2-36c13c931825 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:04.475291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3fc24eeb-cd85-4d8d-b9f2-36c13c931825 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:04.476328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3fc24eeb-cd85-4d8d-b9f2-36c13c931825 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:04.478822 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3fc24eeb-cd85-4d8d-b9f2-36c13c931825 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:04.479457 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3fc24eeb-cd85-4d8d-b9f2-36c13c931825 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:04.648072 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3fc24eeb-cd85-4d8d-b9f2-36c13c931825 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:04.650326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:04.667174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3fc24eeb-cd85-4d8d-b9f2-36c13c931825 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.199279 Jul 20 22:56:04.667174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 424/853] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:04 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:05.042137 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:05.042733 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:05.049785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:05.050225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:05.051027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:05.051448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:05.190990 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:05.201139 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:05.201951 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:05.203170 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d8a0223c-addc-45e7-9cde-3ed0b20783ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.164922 Jul 20 22:56:05.203725 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 430/854] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:05 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:05.682050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6900beef-d596-4391-ad1d-85271baa0353 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:05.682653 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6900beef-d596-4391-ad1d-85271baa0353 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:05.689472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6900beef-d596-4391-ad1d-85271baa0353 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:05.689939 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6900beef-d596-4391-ad1d-85271baa0353 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:05.690680 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6900beef-d596-4391-ad1d-85271baa0353 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:05.691130 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6900beef-d596-4391-ad1d-85271baa0353 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:05.820567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6900beef-d596-4391-ad1d-85271baa0353 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:05.828647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6900beef-d596-4391-ad1d-85271baa0353 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.150848 Jul 20 22:56:05.829221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 425/855] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:05 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:06.220262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:06.220819 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:06.227653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:06.228107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:06.228895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:06.229339 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:06.364602 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:06.373027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:06.374574 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:06.375758 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-60c01039-c75a-48a2-8d07-a2726700dd2f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.159502 Jul 20 22:56:06.376311 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 431/856] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:06 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:06.845233 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fb707ae6-9862-49b7-8002-0430693ca8c5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:06.845879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fb707ae6-9862-49b7-8002-0430693ca8c5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:06.852343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fb707ae6-9862-49b7-8002-0430693ca8c5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:06.852790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fb707ae6-9862-49b7-8002-0430693ca8c5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:06.853550 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fb707ae6-9862-49b7-8002-0430693ca8c5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:06.853989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fb707ae6-9862-49b7-8002-0430693ca8c5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:07.001033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fb707ae6-9862-49b7-8002-0430693ca8c5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:07.004035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fb707ae6-9862-49b7-8002-0430693ca8c5 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.163273 Jul 20 22:56:07.004637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 426/857] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:06 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:07.393713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:07.394326 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:07.400942 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:07.401383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:07.402228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:07.402658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:07.537903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:07.546840 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:07.548444 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:07.549630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-22120094-b4cd-402b-85e6-3550cea04e62 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.159830 Jul 20 22:56:07.550188 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 432/858] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:07 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:08.022827 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5fcbf578-71a3-4742-9882-5a783feedf36 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:08.023835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-5fcbf578-71a3-4742-9882-5a783feedf36 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:08.042307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5fcbf578-71a3-4742-9882-5a783feedf36 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:08.042779 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5fcbf578-71a3-4742-9882-5a783feedf36 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:08.043599 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5fcbf578-71a3-4742-9882-5a783feedf36 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:08.044040 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5fcbf578-71a3-4742-9882-5a783feedf36 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:08.182500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-5fcbf578-71a3-4742-9882-5a783feedf36 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:08.193617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5fcbf578-71a3-4742-9882-5a783feedf36 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.172780 Jul 20 22:56:08.193617 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 427/859] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:08 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:08.567396 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:08.567996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:08.574365 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:08.574809 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:08.575603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:08.576031 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:08.711375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:08.720104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:08.721645 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:08.723499 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1b216a2f-7dc8-46c2-9fbe-de79d875c537 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.159922 Jul 20 22:56:08.724053 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 433/860] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:08 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:09.207399 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-144b6cac-7e05-4780-8fa8-33ba861ac369 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:09.208060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-144b6cac-7e05-4780-8fa8-33ba861ac369 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:09.215110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-144b6cac-7e05-4780-8fa8-33ba861ac369 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:09.215565 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-144b6cac-7e05-4780-8fa8-33ba861ac369 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:09.216339 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-144b6cac-7e05-4780-8fa8-33ba861ac369 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:09.216777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-144b6cac-7e05-4780-8fa8-33ba861ac369 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:09.349053 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-144b6cac-7e05-4780-8fa8-33ba861ac369 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:09.356802 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-144b6cac-7e05-4780-8fa8-33ba861ac369 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.153230 Jul 20 22:56:09.357365 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 428/861] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:09 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:09.740977 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:09.741800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:09.748227 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:09.748671 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:09.750029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:09.750466 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:09.887610 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:09.896918 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:09.898464 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:09.899642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8be24367-3953-4f63-8440-329f4932a1ad tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.162582 Jul 20 22:56:09.900178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 434/862] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:09 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:10.373670 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-321aa563-4433-4620-82ac-894fd8b82957 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:10.374335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-321aa563-4433-4620-82ac-894fd8b82957 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:10.384704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-321aa563-4433-4620-82ac-894fd8b82957 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:10.385379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-321aa563-4433-4620-82ac-894fd8b82957 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:10.386138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-321aa563-4433-4620-82ac-894fd8b82957 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:10.386565 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-321aa563-4433-4620-82ac-894fd8b82957 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:10.541475 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-321aa563-4433-4620-82ac-894fd8b82957 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:10.549085 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-321aa563-4433-4620-82ac-894fd8b82957 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.179270 Jul 20 22:56:10.549649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 429/863] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:10 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:56:10.919503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:10.920097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:10.926165 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:10.926604 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:10.927402 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:10.927827 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:11.093664 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:11.102032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:11.103539 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:11.104680 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b55c3ec8-b7bf-4072-a046-d3bf51507141 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.189021 Jul 20 22:56:11.105229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 435/864] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:10 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:11.565561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-675b5c22-bbe4-4ec2-aec9-ec91548506ba tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:11.566170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-675b5c22-bbe4-4ec2-aec9-ec91548506ba tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:11.572959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-675b5c22-bbe4-4ec2-aec9-ec91548506ba tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:11.573470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-675b5c22-bbe4-4ec2-aec9-ec91548506ba tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:11.574238 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-675b5c22-bbe4-4ec2-aec9-ec91548506ba tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:11.574711 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-675b5c22-bbe4-4ec2-aec9-ec91548506ba tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:11.707588 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-675b5c22-bbe4-4ec2-aec9-ec91548506ba tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:11.724801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-675b5c22-bbe4-4ec2-aec9-ec91548506ba tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.162918 Jul 20 22:56:11.725391 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 430/865] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:11 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:12.123557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:12.124820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:12.131597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:12.132291 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:12.133223 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:12.133752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:12.269092 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:12.284975 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:12.284975 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:12.284975 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c3358cc6-890c-4397-8461-4ba34ac0424f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.161234 Jul 20 22:56:12.285458 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 436/866] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:12 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:12.743348 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a269d099-d687-46bb-a228-45e33cb4e06b tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:12.743956 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a269d099-d687-46bb-a228-45e33cb4e06b tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:12.750784 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a269d099-d687-46bb-a228-45e33cb4e06b tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:12.751265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a269d099-d687-46bb-a228-45e33cb4e06b tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:12.752026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a269d099-d687-46bb-a228-45e33cb4e06b tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:12.752456 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a269d099-d687-46bb-a228-45e33cb4e06b tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:12.888160 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a269d099-d687-46bb-a228-45e33cb4e06b tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:12.895823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a269d099-d687-46bb-a228-45e33cb4e06b tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.156400 Jul 20 22:56:12.896403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 431/867] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:12 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:13.299609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:13.300141 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:13.306362 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:13.306808 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:13.307597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:13.308030 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:13.456583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:13.464995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:13.466569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:13.467748 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-27edc3ca-b9d3-4aa0-b025-63df3d7b6476 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.172710 Jul 20 22:56:13.468997 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 437/868] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:13 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:13.913437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-30497092-f498-4499-b266-714b4a8cecbb tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:13.914047 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-30497092-f498-4499-b266-714b4a8cecbb tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:13.920547 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-30497092-f498-4499-b266-714b4a8cecbb tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:13.921029 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-30497092-f498-4499-b266-714b4a8cecbb tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:13.922343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-30497092-f498-4499-b266-714b4a8cecbb tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:13.922779 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-30497092-f498-4499-b266-714b4a8cecbb tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:14.066982 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-30497092-f498-4499-b266-714b4a8cecbb tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:14.076120 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-30497092-f498-4499-b266-714b4a8cecbb tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1509 microversion: 2.1 time: 0.166908 Jul 20 22:56:14.076693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 432/869] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:13 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:14.093591 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a4f6c8aa-8e4c-4638-9c17-138c057702bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:56:14.094334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a4f6c8aa-8e4c-4638-9c17-138c057702bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:14.100468 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a4f6c8aa-8e4c-4638-9c17-138c057702bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:14.100921 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a4f6c8aa-8e4c-4638-9c17-138c057702bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:14.101690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a4f6c8aa-8e4c-4638-9c17-138c057702bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:14.102122 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a4f6c8aa-8e4c-4638-9c17-138c057702bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:14.135318 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:14.360094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a4f6c8aa-8e4c-4638-9c17-138c057702bd tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "POST /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7/action" status: 202 len: 0 microversion: 2.1 time: 0.270714 Jul 20 22:56:14.361688 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 438/870] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 22:56:14 2022] POST /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:56:14.369588 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-67ef8438-b2d6-4be3-8ae0-1b83a501520f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:14.370199 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-67ef8438-b2d6-4be3-8ae0-1b83a501520f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:14.376981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67ef8438-b2d6-4be3-8ae0-1b83a501520f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:14.377425 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67ef8438-b2d6-4be3-8ae0-1b83a501520f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:14.378300 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67ef8438-b2d6-4be3-8ae0-1b83a501520f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:14.378914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-67ef8438-b2d6-4be3-8ae0-1b83a501520f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:14.488266 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:14.492479 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:14.496317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:14.497052 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:14.498032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:14.498842 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:14.528120 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-67ef8438-b2d6-4be3-8ae0-1b83a501520f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:14.541015 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-67ef8438-b2d6-4be3-8ae0-1b83a501520f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1517 microversion: 2.1 time: 0.175230 Jul 20 22:56:14.541594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 433/871] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:14 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:14.632824 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-d6723dd1-e141-4c2a-a233-787b59938950 req-5932270d-c9d7-4743-bdee-c3b7dc8ee66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7", "name": "network-vif-unplugged", "status": "completed", "tag": "3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:56:14.641802 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-d6723dd1-e141-4c2a-a233-787b59938950 req-5932270d-c9d7-4743-bdee-c3b7dc8ee66a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:14.642247 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-d6723dd1-e141-4c2a-a233-787b59938950 req-5932270d-c9d7-4743-bdee-c3b7dc8ee66a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:14.654955 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.compute.server_external_events [req-d6723dd1-e141-4c2a-a233-787b59938950 req-5932270d-c9d7-4743-bdee-c3b7dc8ee66a service nova] Unable to find a host for instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7. Dropping event network-vif-unplugged {{(pid=124912) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 22:56:14.655891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-d6723dd1-e141-4c2a-a233-787b59938950 req-5932270d-c9d7-4743-bdee-c3b7dc8ee66a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026806 Jul 20 22:56:14.656486 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 434/872] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 22:56:14.729643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:14.738228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:14.739814 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:14.741159 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-253358f2-3077-476b-bb21-c7869f39df60 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.258864 Jul 20 22:56:14.741706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 439/873] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:14 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:15.558923 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6a353673-bb38-417a-a747-a4f8f8b7cbe9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:15.559572 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6a353673-bb38-417a-a747-a4f8f8b7cbe9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:15.566012 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6a353673-bb38-417a-a747-a4f8f8b7cbe9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:15.566455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6a353673-bb38-417a-a747-a4f8f8b7cbe9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:15.567273 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6a353673-bb38-417a-a747-a4f8f8b7cbe9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:15.567703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6a353673-bb38-417a-a747-a4f8f8b7cbe9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:15.704258 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6a353673-bb38-417a-a747-a4f8f8b7cbe9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:15.712187 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6a353673-bb38-417a-a747-a4f8f8b7cbe9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1517 microversion: 2.1 time: 0.157239 Jul 20 22:56:15.712754 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 435/874] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:15 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:15.759949 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:15.760623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:15.762940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=58 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:15.768145 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:15.768609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:15.775911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:15.775911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:15.900702 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:15.909757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:15.911297 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:15.912448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ce31db55-bc06-4874-a9f8-56ce3d134f2e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.156718 Jul 20 22:56:15.912999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 440/875] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:15 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:16.738303 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-79100831-88b2-43e7-9f51-c0ec884a4890 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:16.738904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-79100831-88b2-43e7-9f51-c0ec884a4890 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:16.753564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-79100831-88b2-43e7-9f51-c0ec884a4890 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:16.754020 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-79100831-88b2-43e7-9f51-c0ec884a4890 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:16.754794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-79100831-88b2-43e7-9f51-c0ec884a4890 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:16.755257 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-79100831-88b2-43e7-9f51-c0ec884a4890 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:16.886629 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-79100831-88b2-43e7-9f51-c0ec884a4890 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:16.894078 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-79100831-88b2-43e7-9f51-c0ec884a4890 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1519 microversion: 2.1 time: 0.160364 Jul 20 22:56:16.894640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 436/876] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:16 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:16.930685 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:16.931364 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:16.937782 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:16.938223 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:16.938966 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:16.939418 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:17.071558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:17.079913 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:17.083921 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:17.083921 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f7a57e0b-7cbc-4831-96fd-bb5c4922c39b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.155756 Jul 20 22:56:17.083921 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 441/877] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:16 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:17.910809 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-91e2e12b-77fe-49e8-aa22-1d94f94be899 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:17.911448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-91e2e12b-77fe-49e8-aa22-1d94f94be899 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:17.917985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91e2e12b-77fe-49e8-aa22-1d94f94be899 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:17.918433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91e2e12b-77fe-49e8-aa22-1d94f94be899 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:17.919230 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91e2e12b-77fe-49e8-aa22-1d94f94be899 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:17.919668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-91e2e12b-77fe-49e8-aa22-1d94f94be899 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:18.052835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-91e2e12b-77fe-49e8-aa22-1d94f94be899 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:18.060520 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-91e2e12b-77fe-49e8-aa22-1d94f94be899 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1519 microversion: 2.1 time: 0.153643 Jul 20 22:56:18.061091 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 437/878] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:17 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:18.100724 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:18.101426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:18.108166 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:18.109382 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:18.110373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:18.110821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:18.246340 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:18.254967 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:18.256532 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:18.257680 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f5ccc8d0-3bba-4042-989e-da20de6ef922 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.160820 Jul 20 22:56:18.258235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 442/879] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:18 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:18.629506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-3aa1f1d1-77a5-40b0-aa5b-ca0715c76154 req-2384ad2e-6394-4b60-820f-72146db416bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dca5cf4-1a98-44f6-bcfe-dba13d327330", "name": "network-vif-plugged", "status": "completed", "tag": "bc39b14d-82b6-414a-8492-34acd0bf0123"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:56:18.637663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-3aa1f1d1-77a5-40b0-aa5b-ca0715c76154 req-2384ad2e-6394-4b60-820f-72146db416bd service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:18.638115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-3aa1f1d1-77a5-40b0-aa5b-ca0715c76154 req-2384ad2e-6394-4b60-820f-72146db416bd service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:18.650640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-3aa1f1d1-77a5-40b0-aa5b-ca0715c76154 req-2384ad2e-6394-4b60-820f-72146db416bd service nova] Creating event network-vif-plugged:bc39b14d-82b6-414a-8492-34acd0bf0123 for instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 on hv-cinder-79987 Jul 20 22:56:18.655703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-3aa1f1d1-77a5-40b0-aa5b-ca0715c76154 req-2384ad2e-6394-4b60-820f-72146db416bd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029767 Jul 20 22:56:18.656286 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 438/880] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:56:19.078436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-88cec6a4-9d85-45af-988b-cf546c2d3142 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:19.079174 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-88cec6a4-9d85-45af-988b-cf546c2d3142 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:19.085305 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88cec6a4-9d85-45af-988b-cf546c2d3142 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:19.085753 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88cec6a4-9d85-45af-988b-cf546c2d3142 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:19.086513 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88cec6a4-9d85-45af-988b-cf546c2d3142 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:19.086953 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-88cec6a4-9d85-45af-988b-cf546c2d3142 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:19.225120 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-88cec6a4-9d85-45af-988b-cf546c2d3142 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:19.232613 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-88cec6a4-9d85-45af-988b-cf546c2d3142 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.158684 Jul 20 22:56:19.233161 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 443/881] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:19 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:19.277453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:19.278106 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:19.286048 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:19.286505 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:19.287269 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:19.287765 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:19.415958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:19.425081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:19.426500 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:19.427686 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-af2154e3-eeb2-4c2e-a6b8-eb96a9a0827f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.155165 Jul 20 22:56:19.428242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 439/882] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:19 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:20.248982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-499e75b1-6a84-4513-98b2-fa1eeb869e4f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:20.249591 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-499e75b1-6a84-4513-98b2-fa1eeb869e4f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:20.256034 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-499e75b1-6a84-4513-98b2-fa1eeb869e4f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:20.256487 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-499e75b1-6a84-4513-98b2-fa1eeb869e4f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:20.257242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-499e75b1-6a84-4513-98b2-fa1eeb869e4f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:20.257681 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-499e75b1-6a84-4513-98b2-fa1eeb869e4f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:20.391609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-499e75b1-6a84-4513-98b2-fa1eeb869e4f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:20.399221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-499e75b1-6a84-4513-98b2-fa1eeb869e4f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.154010 Jul 20 22:56:20.399788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 444/883] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:20 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:20.446331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:20.446917 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:20.453985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:20.454429 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:20.455226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:20.455667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:20.582066 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:20.590576 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:20.592100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:20.593255 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-904fd508-746a-48dc-a15e-a0a53aaebd8d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.150945 Jul 20 22:56:20.593811 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 440/884] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:20 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:21.416680 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-40452001-30a5-43f4-84fc-3146388a86a1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:21.417293 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-40452001-30a5-43f4-84fc-3146388a86a1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:21.424390 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-40452001-30a5-43f4-84fc-3146388a86a1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:21.424837 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-40452001-30a5-43f4-84fc-3146388a86a1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:21.425597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-40452001-30a5-43f4-84fc-3146388a86a1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:21.426031 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-40452001-30a5-43f4-84fc-3146388a86a1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:21.611766 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:21.612352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:21.618774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:21.619252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:21.620059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:21.620486 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:21.705309 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-40452001-30a5-43f4-84fc-3146388a86a1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:21.712826 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-40452001-30a5-43f4-84fc-3146388a86a1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.299970 Jul 20 22:56:21.713391 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 445/885] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:21 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:21.752579 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:21.761167 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:21.762654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:21.763831 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-faf3e891-0caa-477a-a808-2e75c1b20cf8 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.156491 Jul 20 22:56:21.764391 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 441/886] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:21 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:22.730534 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-97db5603-9858-4830-98ee-8c4059886e1a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:22.731163 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-97db5603-9858-4830-98ee-8c4059886e1a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:22.738131 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97db5603-9858-4830-98ee-8c4059886e1a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:22.738570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97db5603-9858-4830-98ee-8c4059886e1a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:22.739347 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97db5603-9858-4830-98ee-8c4059886e1a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:22.739775 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-97db5603-9858-4830-98ee-8c4059886e1a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:22.784093 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:22.784714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:22.791394 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:22.791882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:22.792637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:22.793068 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:22.965434 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:22.969212 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=100 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:22.971780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-97db5603-9858-4830-98ee-8c4059886e1a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:22.976376 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:22.977955 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:22.979149 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b70c0514-db9e-4864-a9f6-6db7dad2ba01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.199476 Jul 20 22:56:22.979765 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-97db5603-9858-4830-98ee-8c4059886e1a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.252802 Jul 20 22:56:22.980353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 446/887] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:22 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:22.989045 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 442/888] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:22 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:23.996472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-09025e5d-ab31-410b-9fba-2f3b69872a6a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:23.996987 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-09025e5d-ab31-410b-9fba-2f3b69872a6a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:23.997343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:23.997964 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:24.003549 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09025e5d-ab31-410b-9fba-2f3b69872a6a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:24.004001 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09025e5d-ab31-410b-9fba-2f3b69872a6a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:24.004768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09025e5d-ab31-410b-9fba-2f3b69872a6a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:24.004880 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:24.005208 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-09025e5d-ab31-410b-9fba-2f3b69872a6a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:24.005326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:24.006000 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:24.006440 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:24.148691 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:24.151529 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-09025e5d-ab31-410b-9fba-2f3b69872a6a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:24.157656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-09025e5d-ab31-410b-9fba-2f3b69872a6a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.165078 Jul 20 22:56:24.157985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:24.158215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 447/889] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:23 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:24.159532 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:24.160728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c3c45e3d-fc7d-484a-8e1c-698fb560de9f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.167160 Jul 20 22:56:24.161457 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 443/890] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:23 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:25.175155 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9b06968c-e8d8-480b-b106-0b9092f4a6b1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:25.175768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9b06968c-e8d8-480b-b106-0b9092f4a6b1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:25.178773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:25.179928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:25.182351 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9b06968c-e8d8-480b-b106-0b9092f4a6b1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:25.182804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9b06968c-e8d8-480b-b106-0b9092f4a6b1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:25.183600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9b06968c-e8d8-480b-b106-0b9092f4a6b1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:25.184035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-9b06968c-e8d8-480b-b106-0b9092f4a6b1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:25.186563 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:25.187568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:25.188331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:25.188766 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:25.317930 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9b06968c-e8d8-480b-b106-0b9092f4a6b1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:25.323333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:25.325588 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9b06968c-e8d8-480b-b106-0b9092f4a6b1 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.154356 Jul 20 22:56:25.326169 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 448/891] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:25 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:25.332517 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:25.334028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:25.335209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-85239872-f359-489b-9fbb-05d5ecf875f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.160216 Jul 20 22:56:25.335769 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 444/892] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:25 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:26.343119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a7d3aa12-8b5a-4c92-b372-fc88ae57ee71 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:26.343771 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a7d3aa12-8b5a-4c92-b372-fc88ae57ee71 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:26.350259 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a7d3aa12-8b5a-4c92-b372-fc88ae57ee71 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:26.350708 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a7d3aa12-8b5a-4c92-b372-fc88ae57ee71 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:26.351503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a7d3aa12-8b5a-4c92-b372-fc88ae57ee71 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:26.351939 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a7d3aa12-8b5a-4c92-b372-fc88ae57ee71 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:26.353203 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:26.353850 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:26.360891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:26.361351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:26.362097 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:26.362534 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:26.485365 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a7d3aa12-8b5a-4c92-b372-fc88ae57ee71 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:26.493014 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a7d3aa12-8b5a-4c92-b372-fc88ae57ee71 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.153731 Jul 20 22:56:26.493476 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 449/893] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:26 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:26.495879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:26.504347 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:26.505840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:26.506985 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2fcd3494-b358-4df4-a0bd-8dae1cf6cca4 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.157722 Jul 20 22:56:26.507560 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 445/894] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:26 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:27.511656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a8478297-c806-4d9f-bc12-b9cb7ae1f075 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:27.512265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a8478297-c806-4d9f-bc12-b9cb7ae1f075 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:27.519394 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8478297-c806-4d9f-bc12-b9cb7ae1f075 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:27.519841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8478297-c806-4d9f-bc12-b9cb7ae1f075 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:27.520889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8478297-c806-4d9f-bc12-b9cb7ae1f075 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:27.521668 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a8478297-c806-4d9f-bc12-b9cb7ae1f075 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:27.525581 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:27.526193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:27.532803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:27.533248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:27.534012 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:27.534444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:27.658320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a8478297-c806-4d9f-bc12-b9cb7ae1f075 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:27.666137 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a8478297-c806-4d9f-bc12-b9cb7ae1f075 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.159802 Jul 20 22:56:27.666707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 450/895] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:27 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:56:27.666846 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:27.675705 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:27.677194 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:27.678406 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-29eb38fb-d238-4146-95ff-e520ee382e5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.156557 Jul 20 22:56:27.678950 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 446/896] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:27 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:28.683673 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ed0828e7-0ab4-4f4e-95e0-950446b22212 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:28.684208 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ed0828e7-0ab4-4f4e-95e0-950446b22212 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:28.690661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed0828e7-0ab4-4f4e-95e0-950446b22212 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:28.691135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed0828e7-0ab4-4f4e-95e0-950446b22212 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:28.691903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed0828e7-0ab4-4f4e-95e0-950446b22212 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:28.692343 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed0828e7-0ab4-4f4e-95e0-950446b22212 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:28.697114 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:28.697724 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:28.704836 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:28.705281 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:28.706041 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:28.706496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:28.825856 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ed0828e7-0ab4-4f4e-95e0-950446b22212 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:28.833420 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ed0828e7-0ab4-4f4e-95e0-950446b22212 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.153643 Jul 20 22:56:28.833982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 451/897] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:28 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:28.837441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:28.846271 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:28.847884 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:28.849028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3c880a29-43db-45ca-ad10-2235d3f89507 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.155745 Jul 20 22:56:28.849583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 447/898] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:28 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:29.070716 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-75a94c32-21b7-4155-9049-393b40b48bc3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:29.071245 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-75a94c32-21b7-4155-9049-393b40b48bc3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:29.077207 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-75a94c32-21b7-4155-9049-393b40b48bc3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:29.078292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-75a94c32-21b7-4155-9049-393b40b48bc3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:29.079080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-75a94c32-21b7-4155-9049-393b40b48bc3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:29.079520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-75a94c32-21b7-4155-9049-393b40b48bc3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:29.101805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-75a94c32-21b7-4155-9049-393b40b48bc3 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/ips" status: 200 len: 149 microversion: 2.1 time: 0.034894 Jul 20 22:56:29.102346 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 452/899] 10.222.0.81 () {58 vars in 1247 bytes} [Wed Jul 20 22:56:29 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:56:29.850365 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-94de2d87-98ec-4a86-b797-537e10a5fd95 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:29.851142 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-94de2d87-98ec-4a86-b797-537e10a5fd95 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:29.857570 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-94de2d87-98ec-4a86-b797-537e10a5fd95 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:29.858018 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-94de2d87-98ec-4a86-b797-537e10a5fd95 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:29.859433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-94de2d87-98ec-4a86-b797-537e10a5fd95 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:29.859873 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-94de2d87-98ec-4a86-b797-537e10a5fd95 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:29.866573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:29.867278 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:29.873682 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:29.874064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:29.874817 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:29.875267 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:29.993037 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-94de2d87-98ec-4a86-b797-537e10a5fd95 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:30.000688 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-94de2d87-98ec-4a86-b797-537e10a5fd95 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.154163 Jul 20 22:56:30.001262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 448/900] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:29 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:30.011454 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:30.020356 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:30.021836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:30.022968 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-56601819-b428-4747-9874-bd8ba978667d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.160266 Jul 20 22:56:30.023554 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 453/901] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:29 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:31.017856 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-41be542c-2f3a-4395-b035-549cfc77dce9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:31.018524 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-41be542c-2f3a-4395-b035-549cfc77dce9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:31.029235 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-41be542c-2f3a-4395-b035-549cfc77dce9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:31.029683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-41be542c-2f3a-4395-b035-549cfc77dce9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:31.031052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-41be542c-2f3a-4395-b035-549cfc77dce9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:31.031438 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-41be542c-2f3a-4395-b035-549cfc77dce9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:31.041604 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:31.042875 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:31.050265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:31.054313 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:31.055219 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:31.055671 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:31.181554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-41be542c-2f3a-4395-b035-549cfc77dce9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:31.197188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-41be542c-2f3a-4395-b035-549cfc77dce9 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.182987 Jul 20 22:56:31.206741 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 449/902] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:31 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:31.213548 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:31.216955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:31.222825 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:31.224354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:31.225509 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-87974f40-9a64-4de2-8fe5-15169718fe79 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1808 microversion: 2.20 time: 0.187808 Jul 20 22:56:31.226059 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 454/903] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:31 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:56:31.688622 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-82307cb3-9063-4e8f-a94d-e36a1108cbad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa318940-cb86-4eb5-ab21-40618bd97460"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:56:31.689693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-82307cb3-9063-4e8f-a94d-e36a1108cbad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:31.695841 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82307cb3-9063-4e8f-a94d-e36a1108cbad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:31.696286 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82307cb3-9063-4e8f-a94d-e36a1108cbad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:31.697044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82307cb3-9063-4e8f-a94d-e36a1108cbad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:31.697507 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82307cb3-9063-4e8f-a94d-e36a1108cbad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:32.214710 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ed85850b-c06a-4d75-91e5-eb2ef62ad22f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:32.216064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ed85850b-c06a-4d75-91e5-eb2ef62ad22f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:32.223906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed85850b-c06a-4d75-91e5-eb2ef62ad22f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:32.224354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed85850b-c06a-4d75-91e5-eb2ef62ad22f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:32.225127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed85850b-c06a-4d75-91e5-eb2ef62ad22f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:32.225564 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed85850b-c06a-4d75-91e5-eb2ef62ad22f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:32.355522 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ed85850b-c06a-4d75-91e5-eb2ef62ad22f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:32.363489 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ed85850b-c06a-4d75-91e5-eb2ef62ad22f tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.152709 Jul 20 22:56:32.364058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 455/904] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:32 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:56:32.368521 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:32.369122 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:32.375378 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:32.375827 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:32.376590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:32.377028 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:32.510987 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:32.519641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:32.521174 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:32.522284 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-82307cb3-9063-4e8f-a94d-e36a1108cbad tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "POST /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.837399 Jul 20 22:56:32.522796 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-20a4e116-bf57-4a6c-90dd-ee8bc6dd80a7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1795 microversion: 2.20 time: 0.157453 Jul 20 22:56:32.522903 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 450/905] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 22:56:31 2022] POST /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments => generated 194 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:56:32.526460 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 456/906] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:56:32 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:56:33.382069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ae663a33-444b-4142-85f8-e8f83035e6bc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:33.382774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ae663a33-444b-4142-85f8-e8f83035e6bc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:33.385009 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=56 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:33.390717 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae663a33-444b-4142-85f8-e8f83035e6bc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:33.391218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae663a33-444b-4142-85f8-e8f83035e6bc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:33.392128 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae663a33-444b-4142-85f8-e8f83035e6bc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:33.392573 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae663a33-444b-4142-85f8-e8f83035e6bc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:33.534945 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ae663a33-444b-4142-85f8-e8f83035e6bc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:33.543911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ae663a33-444b-4142-85f8-e8f83035e6bc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.166662 Jul 20 22:56:33.544499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 451/907] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:33 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:34.560431 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b8a12872-f9f3-438f-bc57-60e8222d088a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:34.561065 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b8a12872-f9f3-438f-bc57-60e8222d088a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:34.567722 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b8a12872-f9f3-438f-bc57-60e8222d088a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:34.568172 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b8a12872-f9f3-438f-bc57-60e8222d088a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:34.570422 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b8a12872-f9f3-438f-bc57-60e8222d088a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:34.570422 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b8a12872-f9f3-438f-bc57-60e8222d088a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:34.713408 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b8a12872-f9f3-438f-bc57-60e8222d088a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:34.721767 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b8a12872-f9f3-438f-bc57-60e8222d088a tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.165182 Jul 20 22:56:34.722333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 457/908] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:34 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:35.738749 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b18dd0ce-b68c-4500-b88d-19c88f443bff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:35.739383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b18dd0ce-b68c-4500-b88d-19c88f443bff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:35.745871 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b18dd0ce-b68c-4500-b88d-19c88f443bff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:35.746298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b18dd0ce-b68c-4500-b88d-19c88f443bff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:35.747089 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b18dd0ce-b68c-4500-b88d-19c88f443bff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:35.747524 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b18dd0ce-b68c-4500-b88d-19c88f443bff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:35.876720 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b18dd0ce-b68c-4500-b88d-19c88f443bff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:35.884150 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b18dd0ce-b68c-4500-b88d-19c88f443bff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.149778 Jul 20 22:56:35.884970 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 452/909] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:35 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:36.902228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e2ec54e5-a04c-49a5-943c-2b84d0a56932 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:36.902849 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e2ec54e5-a04c-49a5-943c-2b84d0a56932 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:36.912544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2ec54e5-a04c-49a5-943c-2b84d0a56932 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:36.912999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2ec54e5-a04c-49a5-943c-2b84d0a56932 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:36.913785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2ec54e5-a04c-49a5-943c-2b84d0a56932 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:36.914221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e2ec54e5-a04c-49a5-943c-2b84d0a56932 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:37.050674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e2ec54e5-a04c-49a5-943c-2b84d0a56932 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:37.058224 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e2ec54e5-a04c-49a5-943c-2b84d0a56932 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.160542 Jul 20 22:56:37.058786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 458/910] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:36 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:38.075272 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e3a18718-1650-4147-973d-afd79fd27fff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:38.075887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e3a18718-1650-4147-973d-afd79fd27fff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:38.082986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3a18718-1650-4147-973d-afd79fd27fff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:38.083465 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3a18718-1650-4147-973d-afd79fd27fff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:38.084225 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3a18718-1650-4147-973d-afd79fd27fff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:38.084661 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e3a18718-1650-4147-973d-afd79fd27fff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:38.217018 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e3a18718-1650-4147-973d-afd79fd27fff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:38.225270 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e3a18718-1650-4147-973d-afd79fd27fff tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.153875 Jul 20 22:56:38.225824 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 453/911] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:38 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:39.241947 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ef731149-845b-4203-a6be-a68f24397314 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:39.242561 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ef731149-845b-4203-a6be-a68f24397314 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:39.249012 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ef731149-845b-4203-a6be-a68f24397314 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:39.249486 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ef731149-845b-4203-a6be-a68f24397314 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:39.250256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ef731149-845b-4203-a6be-a68f24397314 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:39.250691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ef731149-845b-4203-a6be-a68f24397314 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:39.379428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ef731149-845b-4203-a6be-a68f24397314 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:39.387217 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ef731149-845b-4203-a6be-a68f24397314 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.149016 Jul 20 22:56:39.387785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 459/912] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:39 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:40.404667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8e44e618-0f01-4a98-96c1-c6e0b47ccd47 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:40.405276 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8e44e618-0f01-4a98-96c1-c6e0b47ccd47 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:40.411982 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e44e618-0f01-4a98-96c1-c6e0b47ccd47 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:40.412403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e44e618-0f01-4a98-96c1-c6e0b47ccd47 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:40.413167 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e44e618-0f01-4a98-96c1-c6e0b47ccd47 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:40.413596 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e44e618-0f01-4a98-96c1-c6e0b47ccd47 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:40.601797 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8e44e618-0f01-4a98-96c1-c6e0b47ccd47 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:40.610178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8e44e618-0f01-4a98-96c1-c6e0b47ccd47 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.209462 Jul 20 22:56:40.613309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 454/913] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:40 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:41.633890 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-27c0b187-285f-499f-a8b9-5f408772fda8 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:41.634568 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-27c0b187-285f-499f-a8b9-5f408772fda8 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:41.640765 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27c0b187-285f-499f-a8b9-5f408772fda8 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:41.641258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27c0b187-285f-499f-a8b9-5f408772fda8 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:41.642043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27c0b187-285f-499f-a8b9-5f408772fda8 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:41.642560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27c0b187-285f-499f-a8b9-5f408772fda8 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:41.782059 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-27c0b187-285f-499f-a8b9-5f408772fda8 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:41.789972 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-27c0b187-285f-499f-a8b9-5f408772fda8 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.160122 Jul 20 22:56:41.793022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 460/914] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:41 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:42.216861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9837f47e-4f64-49bc-a5b7-e49e160dfb96 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:42.217355 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9837f47e-4f64-49bc-a5b7-e49e160dfb96 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:42.224423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9837f47e-4f64-49bc-a5b7-e49e160dfb96 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:42.224871 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9837f47e-4f64-49bc-a5b7-e49e160dfb96 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:42.225626 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9837f47e-4f64-49bc-a5b7-e49e160dfb96 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:42.226057 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9837f47e-4f64-49bc-a5b7-e49e160dfb96 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:42.307401 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-9837f47e-4f64-49bc-a5b7-e49e160dfb96 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lazy-loading 'services' on Instance uuid a732c09e-e99c-4bac-98ad-00a3a6547cc2 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:56:42.505989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9837f47e-4f64-49bc-a5b7-e49e160dfb96 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments/aa318940-cb86-4eb5-ab21-40618bd97460" status: 202 len: 0 microversion: 2.1 time: 0.292743 Jul 20 22:56:42.506501 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 455/915] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 22:56:42 2022] DELETE /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments/aa318940-cb86-4eb5-ab21-40618bd97460 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:56:42.515258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cdc3b848-180c-474f-bba4-47474d36231d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:42.516343 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cdc3b848-180c-474f-bba4-47474d36231d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:42.522475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cdc3b848-180c-474f-bba4-47474d36231d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:42.526909 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cdc3b848-180c-474f-bba4-47474d36231d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:42.526909 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cdc3b848-180c-474f-bba4-47474d36231d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:42.526909 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cdc3b848-180c-474f-bba4-47474d36231d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:42.554083 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cdc3b848-180c-474f-bba4-47474d36231d tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042827 Jul 20 22:56:42.554631 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 461/916] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:56:42 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:56:42.750270 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-5770671a-ea99-46d7-a0a0-d718bd94c3ed req-bb33d16e-09fb-4208-9d1f-254a6517f844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7", "name": "network-vif-plugged", "status": "completed", "tag": "3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:56:42.759612 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5770671a-ea99-46d7-a0a0-d718bd94c3ed req-bb33d16e-09fb-4208-9d1f-254a6517f844 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:42.759612 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5770671a-ea99-46d7-a0a0-d718bd94c3ed req-bb33d16e-09fb-4208-9d1f-254a6517f844 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:42.773726 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-5770671a-ea99-46d7-a0a0-d718bd94c3ed req-bb33d16e-09fb-4208-9d1f-254a6517f844 service nova] Creating event network-vif-plugged:3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf for instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 on hv-cinder-79987 Jul 20 22:56:42.778588 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-5770671a-ea99-46d7-a0a0-d718bd94c3ed req-bb33d16e-09fb-4208-9d1f-254a6517f844 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032558 Jul 20 22:56:42.779217 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 456/917] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:56:42.807520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-dc63424d-6d9c-4d38-ad8b-0be637ba3d6e tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:42.811581 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-dc63424d-6d9c-4d38-ad8b-0be637ba3d6e tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:42.815645 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dc63424d-6d9c-4d38-ad8b-0be637ba3d6e tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:42.816098 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dc63424d-6d9c-4d38-ad8b-0be637ba3d6e tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:42.816921 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dc63424d-6d9c-4d38-ad8b-0be637ba3d6e tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:42.817361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-dc63424d-6d9c-4d38-ad8b-0be637ba3d6e tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:42.951703 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-dc63424d-6d9c-4d38-ad8b-0be637ba3d6e tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:42.959164 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-dc63424d-6d9c-4d38-ad8b-0be637ba3d6e tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.155478 Jul 20 22:56:42.959737 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 462/918] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:42 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:56:43.566914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1beb39af-9379-4ce5-816f-a1c29b97bce1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:43.568000 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1beb39af-9379-4ce5-816f-a1c29b97bce1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:43.574167 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1beb39af-9379-4ce5-816f-a1c29b97bce1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:43.574612 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1beb39af-9379-4ce5-816f-a1c29b97bce1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:43.575392 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1beb39af-9379-4ce5-816f-a1c29b97bce1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:43.581232 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1beb39af-9379-4ce5-816f-a1c29b97bce1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:43.607350 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1beb39af-9379-4ce5-816f-a1c29b97bce1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045175 Jul 20 22:56:43.607919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 457/919] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:56:43 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:56:43.976116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3578caab-a8bd-49be-bcca-6c8e6a2956a3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:43.976700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3578caab-a8bd-49be-bcca-6c8e6a2956a3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:43.983143 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3578caab-a8bd-49be-bcca-6c8e6a2956a3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:43.983590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3578caab-a8bd-49be-bcca-6c8e6a2956a3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:43.987236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3578caab-a8bd-49be-bcca-6c8e6a2956a3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:43.987236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3578caab-a8bd-49be-bcca-6c8e6a2956a3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:44.117209 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3578caab-a8bd-49be-bcca-6c8e6a2956a3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:44.125176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3578caab-a8bd-49be-bcca-6c8e6a2956a3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1575 microversion: 2.1 time: 0.152909 Jul 20 22:56:44.125761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 463/920] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:43 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:44.619108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9cd3a3a8-5ed4-48af-96fb-9a14d316ef25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:44.620060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9cd3a3a8-5ed4-48af-96fb-9a14d316ef25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:44.627064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9cd3a3a8-5ed4-48af-96fb-9a14d316ef25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:44.627512 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9cd3a3a8-5ed4-48af-96fb-9a14d316ef25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:44.628262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9cd3a3a8-5ed4-48af-96fb-9a14d316ef25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:44.628695 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9cd3a3a8-5ed4-48af-96fb-9a14d316ef25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:44.631173 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:44.808907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9cd3a3a8-5ed4-48af-96fb-9a14d316ef25 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.193755 Jul 20 22:56:44.809589 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 458/921] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 22:56:44 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 22:56:44.866803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5d9dcd4b-dc67-46d2-9f26-3c0cfdc4f545 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:44.867361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5d9dcd4b-dc67-46d2-9f26-3c0cfdc4f545 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:44.873649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5d9dcd4b-dc67-46d2-9f26-3c0cfdc4f545 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:44.874288 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5d9dcd4b-dc67-46d2-9f26-3c0cfdc4f545 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:44.875091 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5d9dcd4b-dc67-46d2-9f26-3c0cfdc4f545 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:44.875533 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5d9dcd4b-dc67-46d2-9f26-3c0cfdc4f545 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:44.901040 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5d9dcd4b-dc67-46d2-9f26-3c0cfdc4f545 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:56:45.141950 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9d8a4779-723b-4409-8e47-617148f906df tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:45.142484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9d8a4779-723b-4409-8e47-617148f906df tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:45.148847 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9d8a4779-723b-4409-8e47-617148f906df tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:45.149448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9d8a4779-723b-4409-8e47-617148f906df tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:45.150091 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9d8a4779-723b-4409-8e47-617148f906df tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:45.150525 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9d8a4779-723b-4409-8e47-617148f906df tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:45.206658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5d9dcd4b-dc67-46d2-9f26-3c0cfdc4f545 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 204 len: 0 microversion: 2.1 time: 0.343377 Jul 20 22:56:45.208717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 464/922] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:56:44 2022] DELETE /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:56:45.225322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d43e3bd9-634e-483a-a9c6-4c7b25f4ce38 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:45.226116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d43e3bd9-634e-483a-a9c6-4c7b25f4ce38 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:45.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d43e3bd9-634e-483a-a9c6-4c7b25f4ce38 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:45.233107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d43e3bd9-634e-483a-a9c6-4c7b25f4ce38 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:45.233967 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d43e3bd9-634e-483a-a9c6-4c7b25f4ce38 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:45.234469 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d43e3bd9-634e-483a-a9c6-4c7b25f4ce38 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:45.403068 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d43e3bd9-634e-483a-a9c6-4c7b25f4ce38 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:45.414056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d43e3bd9-634e-483a-a9c6-4c7b25f4ce38 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1682 microversion: 2.1 time: 0.192996 Jul 20 22:56:45.414760 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 465/923] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:45 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:56:45.551796 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9d8a4779-723b-4409-8e47-617148f906df tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:45.559213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9d8a4779-723b-4409-8e47-617148f906df tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1562 microversion: 2.1 time: 0.421436 Jul 20 22:56:45.559775 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 459/924] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:45 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1562 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:56:46.432143 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2d34ba1b-94a0-486f-a53d-c089a7907717 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:46.432747 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2d34ba1b-94a0-486f-a53d-c089a7907717 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:46.435324 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:46.440597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2d34ba1b-94a0-486f-a53d-c089a7907717 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:46.441038 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2d34ba1b-94a0-486f-a53d-c089a7907717 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:46.441824 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2d34ba1b-94a0-486f-a53d-c089a7907717 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:46.442251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2d34ba1b-94a0-486f-a53d-c089a7907717 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:46.572318 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2d34ba1b-94a0-486f-a53d-c089a7907717 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:46.579720 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2d34ba1b-94a0-486f-a53d-c089a7907717 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1682 microversion: 2.1 time: 0.151341 Jul 20 22:56:46.580287 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 466/925] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:46 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:47.603509 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6de2f15d-ea5c-4fb3-a78b-96d2cc7a260b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:47.603509 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6de2f15d-ea5c-4fb3-a78b-96d2cc7a260b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:47.607537 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6de2f15d-ea5c-4fb3-a78b-96d2cc7a260b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:47.607975 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6de2f15d-ea5c-4fb3-a78b-96d2cc7a260b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:47.608913 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6de2f15d-ea5c-4fb3-a78b-96d2cc7a260b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:47.609371 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6de2f15d-ea5c-4fb3-a78b-96d2cc7a260b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:47.750060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6de2f15d-ea5c-4fb3-a78b-96d2cc7a260b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:47.758349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6de2f15d-ea5c-4fb3-a78b-96d2cc7a260b tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1682 microversion: 2.1 time: 0.165302 Jul 20 22:56:47.759072 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 460/926] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:47 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:48.721748 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-c1304559-80d7-4349-8590-6af7581d4a25 req-d4fbcfb1-93e1-4fba-902a-fd32eed7c599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a732c09e-e99c-4bac-98ad-00a3a6547cc2", "name": "network-vif-deleted", "tag": "9c946aca-d30d-47a8-85d4-39572b50ee93"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:56:48.732213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-c1304559-80d7-4349-8590-6af7581d4a25 req-d4fbcfb1-93e1-4fba-902a-fd32eed7c599 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:48.732940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-c1304559-80d7-4349-8590-6af7581d4a25 req-d4fbcfb1-93e1-4fba-902a-fd32eed7c599 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:48.749763 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-c1304559-80d7-4349-8590-6af7581d4a25 req-d4fbcfb1-93e1-4fba-902a-fd32eed7c599 service nova] Creating event network-vif-deleted:9c946aca-d30d-47a8-85d4-39572b50ee93 for instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 on hv-cinder-79987 Jul 20 22:56:48.758156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-c1304559-80d7-4349-8590-6af7581d4a25 req-d4fbcfb1-93e1-4fba-902a-fd32eed7c599 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195675 Jul 20 22:56:48.758858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 467/927] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:56:48.776361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ca196630-555a-4a8a-88a7-7ac7cc2315ae tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:48.776976 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ca196630-555a-4a8a-88a7-7ac7cc2315ae tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:48.786171 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ca196630-555a-4a8a-88a7-7ac7cc2315ae tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:48.786875 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ca196630-555a-4a8a-88a7-7ac7cc2315ae tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:48.787833 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ca196630-555a-4a8a-88a7-7ac7cc2315ae tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:48.788433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ca196630-555a-4a8a-88a7-7ac7cc2315ae tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:48.867839 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ca196630-555a-4a8a-88a7-7ac7cc2315ae tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e072e59bf3e46aaa062ec85b0e2c91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f733781536584f80acfc325bf8444536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:56:48.877226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ca196630-555a-4a8a-88a7-7ac7cc2315ae tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 200 len: 1327 microversion: 2.1 time: 0.104395 Jul 20 22:56:48.879466 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 461/928] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:48 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:56:49.895830 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:49.896555 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:49.903224 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:49.903670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:49.904426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:49.904855 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:49.918468 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 HTTP/1.1 Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:56:49.920106 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:49.921600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'a732c09e-e99c-4bac-98ad-00a3a6547cc2'} Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:56:49.922491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:49.924769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:49.926403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:56:49.926403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-58ed21b5-77df-42f7-9884-31050c495c10 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 404 len: 111 microversion: 2.1 time: 0.030595 Jul 20 22:56:49.926403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 468/929] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:49 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:56:49.930932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d310bce5-ba7c-4dbc-ab52-e54f6bc68521 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '.version_select at 0x7fe243df2820>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:50.044854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d310bce5-ba7c-4dbc-ab52-e54f6bc68521 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956014211" status: 202 len: 0 microversion: 2.1 time: 0.117621 Jul 20 22:56:50.045352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 462/930] 10.222.0.81 () {58 vars in 1220 bytes} [Wed Jul 20 22:56:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956014211 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 22:56:54.186645 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:54.187168 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:54.193880 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:54.194392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:54.195182 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:54.195611 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:54.209390 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 HTTP/1.1 Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:56:54.210926 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.212299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'a732c09e-e99c-4bac-98ad-00a3a6547cc2'} Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:56:54.213056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.214274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.215982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:56:54.215982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a991d21c-c362-44b9-b127-edb79b48df93 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 404 len: 111 microversion: 2.1 time: 0.030021 Jul 20 22:56:54.215982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 469/931] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:56:54 2022] DELETE /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:56:54.222497 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:54.223209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: a732c09e-e99c-4bac-98ad-00a3a6547cc2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:54.230153 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:54.230604 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:54.231390 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:54.231811 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 HTTP/1.1 Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:56:54.258163 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.260657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'a732c09e-e99c-4bac-98ad-00a3a6547cc2'} Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:56:54.261911 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. Jul 20 22:56:54.264309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:54.265702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance a732c09e-e99c-4bac-98ad-00a3a6547cc2 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:56:54.265702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1c5093c1-1df1-4824-9d87-050be83649ee tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2" status: 404 len: 111 microversion: 2.1 time: 0.040561 Jul 20 22:56:54.265702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 463/932] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:54 2022] GET /compute/v2.1/servers/a732c09e-e99c-4bac-98ad-00a3a6547cc2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:56:55.576181 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:55.576704 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:55.583775 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:55.584227 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:55.584987 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:55.585427 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:55.599522 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 HTTP/1.1 Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:56:55.601075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.602635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'ed223901-02ac-40e4-a5df-9d4a3dedc2d2'} Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:56:55.603579 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.605044 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.606539 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:56:55.606539 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-bf267fc1-c057-4c22-97c8-ab40cab4e8ab tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 404 len: 111 microversion: 2.1 time: 0.030075 Jul 20 22:56:55.606539 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 470/933] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:56:55 2022] DELETE /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:56:55.610646 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:55.611277 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: ed223901-02ac-40e4-a5df-9d4a3dedc2d2] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:55.617689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:55.618142 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:55.618906 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:55.619360 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:55.632408 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 HTTP/1.1 Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:56:55.633899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.635701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'ed223901-02ac-40e4-a5df-9d4a3dedc2d2'} Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:56:55.636490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. Jul 20 22:56:55.637683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.638742 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance ed223901-02ac-40e4-a5df-9d4a3dedc2d2 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:56:55.638742 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-828df60e-b01f-4597-bff5-45380facca94 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2" status: 404 len: 111 microversion: 2.1 time: 0.028427 Jul 20 22:56:55.638742 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 464/934] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:55 2022] GET /compute/v2.1/servers/ed223901-02ac-40e4-a5df-9d4a3dedc2d2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:56:55.644475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:55.644965 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:55.650843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:55.651318 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:55.652065 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:55.652495 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:55.666184 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe HTTP/1.1 Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:56:55.667750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.669304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '24366b66-5a54-44ea-95a2-da361e4a3ffe'} Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:56:55.670906 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.672421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.674015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:56:55.674015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-23332928-aecc-409a-a90d-0cfdff6475f1 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 404 len: 111 microversion: 2.1 time: 0.028849 Jul 20 22:56:55.674015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 471/935] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:56:55 2022] DELETE /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:56:55.677382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:56:55.677998 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: 24366b66-5a54-44ea-95a2-da361e4a3ffe] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:56:55.683964 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:55.684409 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:55.685161 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:56:55.685596 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:56:55.699028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe HTTP/1.1 Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:56:55.700557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.702183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '24366b66-5a54-44ea-95a2-da361e4a3ffe'} Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:56:55.703075 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. Jul 20 22:56:55.705147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:56:55.706511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance 24366b66-5a54-44ea-95a2-da361e4a3ffe could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:56:55.706511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1d8c8435-b3f7-4d96-b61d-15f2e966aa2f tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe" status: 404 len: 111 microversion: 2.1 time: 0.028314 Jul 20 22:56:55.706511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 465/936] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:56:55 2022] GET /compute/v2.1/servers/24366b66-5a54-44ea-95a2-da361e4a3ffe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 22:57:00.092351 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:00.092836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:00.099889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:00.100333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:00.101089 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:00.101524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:00.115372 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 HTTP/1.1 Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:57:00.117893 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.120694 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'b26d2070-596e-440d-8b3b-39be974f5bd3'} Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:57:00.121484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.122712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.123943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:57:00.123943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-730f6474-8447-469c-895a-97882cab10c8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 404 len: 111 microversion: 2.1 time: 0.030795 Jul 20 22:57:00.123943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 472/937] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:57:00 2022] DELETE /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:57:00.128006 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:00.128622 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] [instance: b26d2070-596e-440d-8b3b-39be974f5bd3] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:00.135533 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:00.135983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:00.136743 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:00.137180 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:00.152014 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] HTTP exception thrown: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Request method failure captured: Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 HTTP/1.1 Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IWUf5yd_BACrx5LL3ZfbmhuNhKJGk3Qp6yso9JBDSluZSuR1zpaFRk4oCUJZTvWXcdQsYDm4Iu4je63xYiIOvsM-0aY1azuhXX9hAOeuTEAJkvKqdz_vj24QlhX1UkTIjrQx75bCssh9Ji095PdjEd99jov7tDcgbxagb0nJHQ92dE Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: f733781536584f80acfc325bf8444536 Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:57:00.153580 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f733781536584f80acfc325bf8444536", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f733781536584f80acfc325bf8444536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f733781536584f80acfc325bf8444536"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: f733781536584f80acfc325bf8444536 Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25432571 Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 3e072e59bf3e46aaa062ec85b0e2c91a Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeNegativeTest-25432571-project Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.155193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'b26d2070-596e-440d-8b3b-39be974f5bd3'} Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:57:00.156343 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. Jul 20 22:57:00.158326 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:00.160373 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] Returning 404 to user: Instance b26d2070-596e-440d-8b3b-39be974f5bd3 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:57:00.160373 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-48944b10-0374-4965-acce-274226d4cfc8 tempest-AttachVolumeNegativeTest-25432571 tempest-AttachVolumeNegativeTest-25432571-project] 10.222.0.81 "GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3" status: 404 len: 111 microversion: 2.1 time: 0.030854 Jul 20 22:57:00.160373 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 466/938] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:57:00 2022] GET /compute/v2.1/servers/b26d2070-596e-440d-8b3b-39be974f5bd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:57:40.202781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e257727e-c6fe-4746-b867-35f57219404c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:40.203256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e257727e-c6fe-4746-b867-35f57219404c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:40.206050 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=13 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:40.206783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:40.211530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e257727e-c6fe-4746-b867-35f57219404c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:40.211999 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e257727e-c6fe-4746-b867-35f57219404c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:40.212799 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e257727e-c6fe-4746-b867-35f57219404c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:40.213222 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e257727e-c6fe-4746-b867-35f57219404c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:40.246120 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e257727e-c6fe-4746-b867-35f57219404c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments/9b6c5949-ca4e-48b7-8de1-2106ede3ee2a" status: 200 len: 194 microversion: 2.20 time: 0.047592 Jul 20 22:57:40.246706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 473/939] 10.222.0.81 () {60 vars in 1453 bytes} [Wed Jul 20 22:57:40 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments/9b6c5949-ca4e-48b7-8de1-2106ede3ee2a => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:57:40.310666 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-01e5f97d-5659-43a6-822d-fc3496fc2bf9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:40.311312 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-01e5f97d-5659-43a6-822d-fc3496fc2bf9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:40.313332 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:40.314479 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=31 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:40.319456 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-01e5f97d-5659-43a6-822d-fc3496fc2bf9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:40.320363 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-01e5f97d-5659-43a6-822d-fc3496fc2bf9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:40.320730 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-01e5f97d-5659-43a6-822d-fc3496fc2bf9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:40.321172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-01e5f97d-5659-43a6-822d-fc3496fc2bf9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:40.402017 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-01e5f97d-5659-43a6-822d-fc3496fc2bf9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lazy-loading 'services' on Instance uuid 0dca5cf4-1a98-44f6-bcfe-dba13d327330 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:57:40.649595 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-01e5f97d-5659-43a6-822d-fc3496fc2bf9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments/9b6c5949-ca4e-48b7-8de1-2106ede3ee2a" status: 202 len: 0 microversion: 2.20 time: 0.342747 Jul 20 22:57:40.650289 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 467/940] 10.222.0.81 () {60 vars in 1456 bytes} [Wed Jul 20 22:57:40 2022] DELETE /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments/9b6c5949-ca4e-48b7-8de1-2106ede3ee2a => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 22:57:40.658891 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ce356fb3-51cd-4738-93e7-20f22ba4c41e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:40.659862 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ce356fb3-51cd-4738-93e7-20f22ba4c41e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:40.666494 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce356fb3-51cd-4738-93e7-20f22ba4c41e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:40.666944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce356fb3-51cd-4738-93e7-20f22ba4c41e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:40.667780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce356fb3-51cd-4738-93e7-20f22ba4c41e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:40.668222 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ce356fb3-51cd-4738-93e7-20f22ba4c41e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:40.698018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ce356fb3-51cd-4738-93e7-20f22ba4c41e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043150 Jul 20 22:57:40.698832 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 474/941] 10.222.0.81 () {60 vars in 1342 bytes} [Wed Jul 20 22:57:40 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:57:41.711514 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d4ab2a69-14ea-4e5b-8b44-a54643295f0d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:41.712568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d4ab2a69-14ea-4e5b-8b44-a54643295f0d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:41.719265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4ab2a69-14ea-4e5b-8b44-a54643295f0d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:41.719718 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4ab2a69-14ea-4e5b-8b44-a54643295f0d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:41.720482 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4ab2a69-14ea-4e5b-8b44-a54643295f0d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:41.720941 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4ab2a69-14ea-4e5b-8b44-a54643295f0d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:41.750963 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d4ab2a69-14ea-4e5b-8b44-a54643295f0d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044314 Jul 20 22:57:41.752038 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 468/942] 10.222.0.81 () {60 vars in 1342 bytes} [Wed Jul 20 22:57:41 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 22:57:42.763795 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-02540e89-feeb-4542-850b-3c05dcb91fa0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:42.764710 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-02540e89-feeb-4542-850b-3c05dcb91fa0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:42.772292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02540e89-feeb-4542-850b-3c05dcb91fa0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:42.779576 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02540e89-feeb-4542-850b-3c05dcb91fa0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:42.779576 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02540e89-feeb-4542-850b-3c05dcb91fa0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:42.779576 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-02540e89-feeb-4542-850b-3c05dcb91fa0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:42.802445 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-02540e89-feeb-4542-850b-3c05dcb91fa0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043031 Jul 20 22:57:42.803117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 475/943] 10.222.0.81 () {60 vars in 1342 bytes} [Wed Jul 20 22:57:42 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:57:42.859991 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d778f482-74f8-4a3b-8c77-95e9432eaa5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:42.860508 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d778f482-74f8-4a3b-8c77-95e9432eaa5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:42.866892 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d778f482-74f8-4a3b-8c77-95e9432eaa5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:42.867383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d778f482-74f8-4a3b-8c77-95e9432eaa5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:42.868150 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d778f482-74f8-4a3b-8c77-95e9432eaa5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:42.868585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d778f482-74f8-4a3b-8c77-95e9432eaa5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:42.894066 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d778f482-74f8-4a3b-8c77-95e9432eaa5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:57:43.164662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d778f482-74f8-4a3b-8c77-95e9432eaa5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 204 len: 0 microversion: 2.20 time: 0.308227 Jul 20 22:57:43.165253 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 469/944] 10.222.0.81 () {60 vars in 1279 bytes} [Wed Jul 20 22:57:42 2022] DELETE /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 22:57:43.174015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:43.174631 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:43.181274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:43.181728 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:43.182503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:43.182939 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:43.322883 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:43.331875 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:43.333381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:43.334517 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-53b983de-de8a-4047-a62d-d0a5e681d1d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.165131 Jul 20 22:57:43.335102 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 476/945] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:43 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:57:44.353241 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:44.353902 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:44.360602 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:44.361060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:44.361817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:44.362244 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:44.498038 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:44.506437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:44.507962 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:44.509107 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-dc256ec2-0f5d-46c3-8106-a4ae692f5346 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.160193 Jul 20 22:57:44.509659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 470/946] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:44 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:57:45.528120 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:45.528880 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:45.535244 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:45.535690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:45.536596 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:45.537030 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:45.779879 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:45.789074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:45.790577 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:45.791834 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-91d81e7c-3da6-49b3-b13e-23bd6a964982 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1723 microversion: 2.20 time: 0.267666 Jul 20 22:57:45.792409 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 477/947] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:45 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:57:46.285890 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-1484ba78-1eaa-4076-8547-6a1fada70e6b req-185fa2c1-f7f1-488e-b77e-198f89eff0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dca5cf4-1a98-44f6-bcfe-dba13d327330", "name": "network-vif-deleted", "tag": "bc39b14d-82b6-414a-8492-34acd0bf0123"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:57:46.294582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-1484ba78-1eaa-4076-8547-6a1fada70e6b req-185fa2c1-f7f1-488e-b77e-198f89eff0fd service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:46.295142 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-1484ba78-1eaa-4076-8547-6a1fada70e6b req-185fa2c1-f7f1-488e-b77e-198f89eff0fd service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:46.306885 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-1484ba78-1eaa-4076-8547-6a1fada70e6b req-185fa2c1-f7f1-488e-b77e-198f89eff0fd service nova] Creating event network-vif-deleted:bc39b14d-82b6-414a-8492-34acd0bf0123 for instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 on hv-cinder-79987 Jul 20 22:57:46.312042 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-1484ba78-1eaa-4076-8547-6a1fada70e6b req-185fa2c1-f7f1-488e-b77e-198f89eff0fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029932 Jul 20 22:57:46.314890 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 471/948] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:57:46.809973 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:46.810851 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:46.819195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:46.819768 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:46.820826 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:46.821348 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:46.858866 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:46.859435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:46.860074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lazy-loading 'fault' on Instance uuid 0dca5cf4-1a98-44f6-bcfe-dba13d327330 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:57:46.900559 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:46.911730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:46.912294 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:46.913613 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-800fb9da-65be-44c8-8e5e-140136ac984b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 200 len: 1371 microversion: 2.20 time: 0.107711 Jul 20 22:57:46.929618 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 478/949] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:46 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:57:47.933366 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:47.934069 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:47.941324 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:47.941925 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:47.943107 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:47.943672 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:47.957298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] HTTP exception thrown: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Request method failure captured: Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 HTTP/1.1 Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IdiySP8hM8EtIpOyagRdXbvkGpasHBuuCqPeLLHNN4L0PGOPNBpzA_KbJ94QHChkKS6FIPkj-qfy5--xSRCVNDkLrw6KxJ3-dTK3-SsmCKzXoONJ_5BiiCpyUVhLfEWpEeBVWJgIxaD1rLSXirbre75JzXnZZ_njIGOsh3Au0YLkbI Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:57:47.958904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ace18b7cfda4329adb560220ff909cc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: bc19753d420840ffa5cde19d4c1fac8f Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 22:57:47.960663 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '0dca5cf4-1a98-44f6-bcfe-dba13d327330'} Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:57:47.961946 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 22:57:47.963481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:57:47.964896 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Returning 404 to user: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:57:47.964896 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-34da81ff-b8dd-4ee6-ac9f-07d785b14961 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 404 len: 111 microversion: 2.20 time: 0.031654 Jul 20 22:57:47.964896 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 472/950] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:47 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 22:57:47.969267 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1ccbb321-fa98-47ac-9621-7b7d13945216 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '.version_select at 0x7fe243db74c0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:48.034284 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1ccbb321-fa98-47ac-9621-7b7d13945216 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834038787" status: 204 len: 0 microversion: 2.20 time: 0.068694 Jul 20 22:57:48.035264 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 479/951] 10.222.0.81 () {60 vars in 1258 bytes} [Wed Jul 20 22:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834038787 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 22:57:48.860415 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ea3e150f-7998-4981-8980-c84402ddec11 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'create', calling method: .version_select at 0x7fe243d79550>, body: {"keypair": {"name": "tempest-keypair-1682444703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEl+FBNeGBoNvnkuCC+Vae2TERJyWvOA1wjJwBAaX0VCPQ8aScady+wgRBYt3dLiTfvMJ2avhItZeMxQPmoennpeWeIc0BO9+aRN7fJugISqxql6Ex0lLLHarCo414kgaw=="}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:57:48.873899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-ea3e150f-7998-4981-8980-c84402ddec11 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Getting quotas for project 7ace18b7cfda4329adb560220ff909cc. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:57:48.877771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-ea3e150f-7998-4981-8980-c84402ddec11 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Getting quotas for user bc19753d420840ffa5cde19d4c1fac8f and project 7ace18b7cfda4329adb560220ff909cc. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:57:48.971324 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ea3e150f-7998-4981-8980-c84402ddec11 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.114670 Jul 20 22:57:48.971967 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 473/952] 10.222.0.81 () {62 vars in 1199 bytes} [Wed Jul 20 22:57:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 22:57:51.951258 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-435972596", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c618a1c-50e1-4062-bdfe-9e52756a99e5"}], "security_groups": [{"name": "tempest-securitygroup--1203824797"}], "key_name": "tempest-keypair-1682444703", "user_data": "}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:57:52.065741 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] validate_networks() for [('4c618a1c-50e1-4062-bdfe-9e52756a99e5', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:57:52.547268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:57:52.547713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:57:52.548681 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:57:52.549110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:57:52.549518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:57:52.558461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:52.558903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:52.559720 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:52.565036 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:52.576825 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Getting quotas for project 7ace18b7cfda4329adb560220ff909cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:57:52.580747 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Getting quotas for user bc19753d420840ffa5cde19d4c1fac8f and project 7ace18b7cfda4329adb560220ff909cc. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:57:52.591464 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:57:52.593687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:57:52.731917 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3078f299-a5b5-489a-8ba1-39223e207d5e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.786009 Jul 20 22:57:52.732923 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 480/953] 10.222.0.81 () {62 vars in 1187 bytes} [Wed Jul 20 22:57:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 22:57:52.744084 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c8682569-b457-4d2c-8ce0-800e3d2a5a29 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:52.744714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c8682569-b457-4d2c-8ce0-800e3d2a5a29 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:52.801316 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c8682569-b457-4d2c-8ce0-800e3d2a5a29 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:52.808932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c8682569-b457-4d2c-8ce0-800e3d2a5a29 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:52.810461 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c8682569-b457-4d2c-8ce0-800e3d2a5a29 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:52.811594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c8682569-b457-4d2c-8ce0-800e3d2a5a29 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1281 microversion: 2.20 time: 0.072118 Jul 20 22:57:52.812140 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 474/954] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:52 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:57:53.830779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:53.831433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:53.838291 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:53.838731 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:53.839498 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:53.839928 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:53.900831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:53.908822 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:53.910324 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:53.911436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e9a56fba-77ca-4e76-a72b-c41c9f365389 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1285 microversion: 2.20 time: 0.085690 Jul 20 22:57:53.911983 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 481/955] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:53 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:57:54.928613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:54.929211 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:54.935881 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:54.936325 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:54.937084 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:54.937518 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:55.001004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:55.009547 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:55.012943 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:55.012943 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0ee19187-f78e-4485-8229-01fa7b54caea tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1341 microversion: 2.20 time: 0.087899 Jul 20 22:57:55.013151 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 475/956] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:54 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1341 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:57:55.237315 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1621654075", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "networks": [{"uuid": "c86e9e7a-5907-4940-b6d7-ad82cb3693a8"}]}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:57:55.289274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] validate_networks() for [('c86e9e7a-5907-4940-b6d7-ad82cb3693a8', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:57:55.862280 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:57:55.862922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:57:55.863425 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:57:55.864249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:57:55.864664 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:57:55.873192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:55.873723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:55.874542 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:55.874972 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:55.893448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Getting quotas for project 2052ef42be464cc98e98aa5da24ee7ae. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:57:55.897241 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Getting quotas for user d8e921b8bae145aeb67fe1f1497c502e and project 2052ef42be464cc98e98aa5da24ee7ae. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:57:55.908240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:57:55.910377 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:57:56.031750 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:56.033188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:56.040773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:56.041545 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:56.042623 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:56.043300 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:56.054502 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b7099725-8cf0-4207-a841-419b97ab6655 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820935 Jul 20 22:57:56.062227 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 482/957] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:57:56.074105 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9dcc08ef-8539-4e83-8549-e674ab32f6bc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:56.075065 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9dcc08ef-8539-4e83-8549-e674ab32f6bc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:56.167089 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9dcc08ef-8539-4e83-8549-e674ab32f6bc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:56.174600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9dcc08ef-8539-4e83-8549-e674ab32f6bc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1214 microversion: 2.1 time: 0.108646 Jul 20 22:57:56.188054 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 483/958] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:57:56 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:57:56.201546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:56.212124 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:56.213782 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:56.214888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-385f8d7d-937e-49fc-88df-51e40a29fd71 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.187418 Jul 20 22:57:56.215744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 476/959] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:56 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:57:57.042225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-8114dd82-b8fa-41c4-a904-1f408a17380e req-79972bdc-855c-450e-9c2c-8c10a8134cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67b8fa1-b3a3-4778-86bd-b47c4351325e", "tag": "41607f00-87e1-4b7a-ab9d-322990f3e718"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:57:57.054102 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-8114dd82-b8fa-41c4-a904-1f408a17380e req-79972bdc-855c-450e-9c2c-8c10a8134cfc service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:57.054544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-8114dd82-b8fa-41c4-a904-1f408a17380e req-79972bdc-855c-450e-9c2c-8c10a8134cfc service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:57.070799 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-8114dd82-b8fa-41c4-a904-1f408a17380e req-79972bdc-855c-450e-9c2c-8c10a8134cfc service nova] Creating event network-changed:41607f00-87e1-4b7a-ab9d-322990f3e718 for instance e67b8fa1-b3a3-4778-86bd-b47c4351325e on hv-cinder-79987 Jul 20 22:57:57.076305 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-8114dd82-b8fa-41c4-a904-1f408a17380e req-79972bdc-855c-450e-9c2c-8c10a8134cfc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037735 Jul 20 22:57:57.077568 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 484/960] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:57:57.200625 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-804cd86a-a855-4dc1-a214-f7d054c86c3b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:57.201268 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-804cd86a-a855-4dc1-a214-f7d054c86c3b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:57.234517 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:57.236273 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:57.245514 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:57.246015 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:57.247127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:57.247818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:57.259869 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-804cd86a-a855-4dc1-a214-f7d054c86c3b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:57.267387 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-804cd86a-a855-4dc1-a214-f7d054c86c3b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1214 microversion: 2.1 time: 0.071041 Jul 20 22:57:57.277089 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 477/961] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:57:57 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:57:57.548023 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:57.556564 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:57.558144 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:57.559978 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f404f996-4bec-4e93-b506-10d82d0e4d7d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.329103 Jul 20 22:57:57.559978 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 485/962] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:57 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 22:57:58.284269 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-02be15d7-abb7-486a-9a12-b8e48443969b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:58.284873 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-02be15d7-abb7-486a-9a12-b8e48443969b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:58.291937 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-02be15d7-abb7-486a-9a12-b8e48443969b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:58.292385 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-02be15d7-abb7-486a-9a12-b8e48443969b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:58.293130 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-02be15d7-abb7-486a-9a12-b8e48443969b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:58.293558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-02be15d7-abb7-486a-9a12-b8e48443969b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:58.353219 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-02be15d7-abb7-486a-9a12-b8e48443969b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:58.361231 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-02be15d7-abb7-486a-9a12-b8e48443969b tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1266 microversion: 2.1 time: 0.080334 Jul 20 22:57:58.361777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 478/963] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:57:58 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:57:58.577180 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:58.577776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:58.584321 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:58.584785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:58.585534 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:58.585957 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:58.714187 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:58.722774 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:58.724286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:58.725480 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c73f73c5-f57f-405c-8df1-38ccdfb2d00d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.152171 Jul 20 22:57:58.726024 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 486/964] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:58 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:57:59.378248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1bb1296f-c544-4563-b743-7f183ac45832 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:59.386133 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1bb1296f-c544-4563-b743-7f183ac45832 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:59.386133 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1bb1296f-c544-4563-b743-7f183ac45832 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:59.386351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1bb1296f-c544-4563-b743-7f183ac45832 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:59.387106 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1bb1296f-c544-4563-b743-7f183ac45832 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:59.387541 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1bb1296f-c544-4563-b743-7f183ac45832 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:59.448813 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1bb1296f-c544-4563-b743-7f183ac45832 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:59.456231 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1bb1296f-c544-4563-b743-7f183ac45832 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1266 microversion: 2.1 time: 0.082474 Jul 20 22:57:59.456785 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 479/965] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:57:59 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:57:59.743982 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:57:59.744526 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:57:59.750840 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:59.751317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:59.752074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:57:59.752511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:57:59.880560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:59.888741 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:59.890253 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:57:59.891364 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-bbe5866e-016d-4630-9b8d-85bf3cc8d1b0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.151265 Jul 20 22:57:59.892421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 487/966] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:57:59 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:58:00.473570 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-723afd4e-9b09-453d-aebf-048496e8c6fc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:00.474909 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-723afd4e-9b09-453d-aebf-048496e8c6fc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:00.483685 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-723afd4e-9b09-453d-aebf-048496e8c6fc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:00.484295 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-723afd4e-9b09-453d-aebf-048496e8c6fc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:00.485458 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-723afd4e-9b09-453d-aebf-048496e8c6fc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:00.486706 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-723afd4e-9b09-453d-aebf-048496e8c6fc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:00.558431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-723afd4e-9b09-453d-aebf-048496e8c6fc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:00.566064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-723afd4e-9b09-453d-aebf-048496e8c6fc tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1274 microversion: 2.1 time: 0.097010 Jul 20 22:58:00.571051 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 480/967] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:00 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:00.910043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:00.910647 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:00.917162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:00.917601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:00.918359 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:00.918789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:01.372722 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:01.381740 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:01.383270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:01.384479 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3e59b968-3287-40f0-8ebf-1a665b4cd23b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.478443 Jul 20 22:58:01.385038 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 488/968] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:58:00 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:58:01.583213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-33c7e811-3fea-4f65-9064-f20f1ee1a2a2 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:01.583942 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-33c7e811-3fea-4f65-9064-f20f1ee1a2a2 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:01.590535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-33c7e811-3fea-4f65-9064-f20f1ee1a2a2 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:01.590989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-33c7e811-3fea-4f65-9064-f20f1ee1a2a2 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:01.591795 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-33c7e811-3fea-4f65-9064-f20f1ee1a2a2 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:01.592313 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-33c7e811-3fea-4f65-9064-f20f1ee1a2a2 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:01.724664 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-33c7e811-3fea-4f65-9064-f20f1ee1a2a2 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:01.732217 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-33c7e811-3fea-4f65-9064-f20f1ee1a2a2 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.152901 Jul 20 22:58:01.732828 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 481/969] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:01 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:02.402004 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:02.402632 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:02.409072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:02.409524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:02.410398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:02.410839 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:02.554113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-f170eb1d-f956-446d-b5e3-b4b640bbeebd req-f57ec401-7225-4c89-87a5-ef74f1e071f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e036851-7855-49e6-8f90-5e3c506284bf", "tag": "e911730b-322f-4389-b750-fb1ba19cdb6a"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:02.562240 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-f170eb1d-f956-446d-b5e3-b4b640bbeebd req-f57ec401-7225-4c89-87a5-ef74f1e071f6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:02.562674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-f170eb1d-f956-446d-b5e3-b4b640bbeebd req-f57ec401-7225-4c89-87a5-ef74f1e071f6 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:02.573907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-f170eb1d-f956-446d-b5e3-b4b640bbeebd req-f57ec401-7225-4c89-87a5-ef74f1e071f6 service nova] Creating event network-changed:e911730b-322f-4389-b750-fb1ba19cdb6a for instance 7e036851-7855-49e6-8f90-5e3c506284bf on hv-cinder-79987 Jul 20 22:58:02.578900 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-f170eb1d-f956-446d-b5e3-b4b640bbeebd req-f57ec401-7225-4c89-87a5-ef74f1e071f6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029343 Jul 20 22:58:02.579522 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 482/970] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:58:02.598617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:02.607818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:02.609317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:02.610439 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-57fb1dfc-44bf-463f-9fce-d090a20c662a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.212457 Jul 20 22:58:02.611723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 489/971] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:58:02 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:58:02.750223 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ce2e4550-2c58-43fc-99e9-7ee81c0bd421 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:02.751118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ce2e4550-2c58-43fc-99e9-7ee81c0bd421 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:02.758611 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce2e4550-2c58-43fc-99e9-7ee81c0bd421 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:02.758611 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce2e4550-2c58-43fc-99e9-7ee81c0bd421 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:02.759476 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce2e4550-2c58-43fc-99e9-7ee81c0bd421 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:02.759914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce2e4550-2c58-43fc-99e9-7ee81c0bd421 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:02.902785 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ce2e4550-2c58-43fc-99e9-7ee81c0bd421 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:02.911176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ce2e4550-2c58-43fc-99e9-7ee81c0bd421 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.165093 Jul 20 22:58:02.914183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 483/972] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:02 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:03.629977 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:03.630580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:03.637374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:03.637821 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:03.638580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:03.639029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:03.776041 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:03.784538 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:03.786578 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:03.787232 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-750e216e-a626-41ad-9d2c-7f15b6138295 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.161720 Jul 20 22:58:03.787800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 490/973] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:58:03 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:58:03.928999 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-df17f3db-68b1-4fef-b174-8ea7da7c5652 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:03.929612 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-df17f3db-68b1-4fef-b174-8ea7da7c5652 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:03.936065 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-df17f3db-68b1-4fef-b174-8ea7da7c5652 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:03.936508 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-df17f3db-68b1-4fef-b174-8ea7da7c5652 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:03.937262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-df17f3db-68b1-4fef-b174-8ea7da7c5652 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:03.937693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-df17f3db-68b1-4fef-b174-8ea7da7c5652 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:04.065662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-df17f3db-68b1-4fef-b174-8ea7da7c5652 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:04.073107 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-df17f3db-68b1-4fef-b174-8ea7da7c5652 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.148049 Jul 20 22:58:04.073658 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 484/974] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:03 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:04.805181 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:04.805778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:04.812374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:04.814375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:04.814375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:04.814619 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:04.950927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:04.960679 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:04.962221 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:04.963368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-264c86ad-d37a-46fa-a915-3f7f68999402 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.162111 Jul 20 22:58:04.963936 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 491/975] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:58:04 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:58:05.000129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-d4a9816f-66ce-47cb-b486-07539023e76a req-ee4bf16a-53e7-4e45-8c0a-9f090e9d1883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67b8fa1-b3a3-4778-86bd-b47c4351325e", "name": "network-vif-plugged", "status": "completed", "tag": "41607f00-87e1-4b7a-ab9d-322990f3e718"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:05.008607 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-d4a9816f-66ce-47cb-b486-07539023e76a req-ee4bf16a-53e7-4e45-8c0a-9f090e9d1883 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:05.009040 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-d4a9816f-66ce-47cb-b486-07539023e76a req-ee4bf16a-53e7-4e45-8c0a-9f090e9d1883 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:05.020529 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-d4a9816f-66ce-47cb-b486-07539023e76a req-ee4bf16a-53e7-4e45-8c0a-9f090e9d1883 service nova] Creating event network-vif-plugged:41607f00-87e1-4b7a-ab9d-322990f3e718 for instance e67b8fa1-b3a3-4778-86bd-b47c4351325e on hv-cinder-79987 Jul 20 22:58:05.025223 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-d4a9816f-66ce-47cb-b486-07539023e76a req-ee4bf16a-53e7-4e45-8c0a-9f090e9d1883 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151362 Jul 20 22:58:05.026105 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 485/976] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:58:05.089455 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ba18b041-069a-4b2e-b083-f2565b6164f6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:05.090092 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ba18b041-069a-4b2e-b083-f2565b6164f6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:05.096370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba18b041-069a-4b2e-b083-f2565b6164f6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:05.096820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba18b041-069a-4b2e-b083-f2565b6164f6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:05.097619 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba18b041-069a-4b2e-b083-f2565b6164f6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:05.098055 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba18b041-069a-4b2e-b083-f2565b6164f6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:05.230249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ba18b041-069a-4b2e-b083-f2565b6164f6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:05.239223 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ba18b041-069a-4b2e-b083-f2565b6164f6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.153665 Jul 20 22:58:05.239791 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 492/977] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:05 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:05.982211 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:05.982904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:05.989048 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:05.989492 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:05.990236 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:05.990668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:06.118662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:06.122241 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:06.126974 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:06.128484 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:06.129575 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b6bea1e6-cb77-403c-a593-4b61f46caee0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.152051 Jul 20 22:58:06.130122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 486/978] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:58:05 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:58:06.256590 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-42195743-d2ff-4c20-bfe6-d758bc2059be tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:06.257197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-42195743-d2ff-4c20-bfe6-d758bc2059be tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:06.259583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=4 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:06.260516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=14 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:06.265781 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-42195743-d2ff-4c20-bfe6-d758bc2059be tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:06.266218 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-42195743-d2ff-4c20-bfe6-d758bc2059be tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:06.267730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-42195743-d2ff-4c20-bfe6-d758bc2059be tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:06.268242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-42195743-d2ff-4c20-bfe6-d758bc2059be tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:06.272246 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:06.396366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-42195743-d2ff-4c20-bfe6-d758bc2059be tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:06.403836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-42195743-d2ff-4c20-bfe6-d758bc2059be tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.151101 Jul 20 22:58:06.404813 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 493/979] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:06 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:07.148549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:07.149204 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:07.156271 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:07.156715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:07.157489 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:07.157920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:07.264410 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=8 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:07.295630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:07.303689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:07.305202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:07.306285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-381d5f5e-7ac1-4681-b72d-57e10e8fe593 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1407 microversion: 2.20 time: 0.161679 Jul 20 22:58:07.306838 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 487/980] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:58:07 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:58:07.421501 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e4261475-b95c-4eaa-a394-fa2a7ad3b158 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:07.422238 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e4261475-b95c-4eaa-a394-fa2a7ad3b158 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:07.429340 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4261475-b95c-4eaa-a394-fa2a7ad3b158 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:07.429787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4261475-b95c-4eaa-a394-fa2a7ad3b158 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:07.430549 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4261475-b95c-4eaa-a394-fa2a7ad3b158 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:07.430984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4261475-b95c-4eaa-a394-fa2a7ad3b158 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:07.587626 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e4261475-b95c-4eaa-a394-fa2a7ad3b158 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:07.595184 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e4261475-b95c-4eaa-a394-fa2a7ad3b158 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.177507 Jul 20 22:58:07.595777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 494/981] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:07 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:08.324613 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:08.325261 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:08.332188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:08.332633 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:08.333383 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:08.333815 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:08.460874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:08.468773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:08.470821 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:08.471990 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b5168160-3b10-4346-9c5d-0131c7370a9c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1599 microversion: 2.20 time: 0.151275 Jul 20 22:58:08.472554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 488/982] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:58:08 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:58:08.489720 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2efcfcc8-9521-4e58-b9ea-59c6f56040f3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:08.490236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2efcfcc8-9521-4e58-b9ea-59c6f56040f3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:08.496640 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2efcfcc8-9521-4e58-b9ea-59c6f56040f3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:08.497097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2efcfcc8-9521-4e58-b9ea-59c6f56040f3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:08.497861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2efcfcc8-9521-4e58-b9ea-59c6f56040f3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:08.498306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2efcfcc8-9521-4e58-b9ea-59c6f56040f3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:08.573858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2efcfcc8-9521-4e58-b9ea-59c6f56040f3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088453 Jul 20 22:58:08.574449 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 495/983] 10.222.0.81 () {60 vars in 1315 bytes} [Wed Jul 20 22:58:08 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:58:08.612751 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ce27b5b3-87ca-4c88-9913-59a88600d520 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:08.613385 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ce27b5b3-87ca-4c88-9913-59a88600d520 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:08.619345 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce27b5b3-87ca-4c88-9913-59a88600d520 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:08.619788 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce27b5b3-87ca-4c88-9913-59a88600d520 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:08.620543 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce27b5b3-87ca-4c88-9913-59a88600d520 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:08.620978 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ce27b5b3-87ca-4c88-9913-59a88600d520 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:08.754350 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ce27b5b3-87ca-4c88-9913-59a88600d520 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:08.762126 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ce27b5b3-87ca-4c88-9913-59a88600d520 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.153936 Jul 20 22:58:08.762683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 489/984] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:08 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:08.893393 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-292ab105-53fd-4879-8f82-ba37f19c159d req-4c7eda58-f4b6-4ce3-9ae8-e0b06a14f738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e036851-7855-49e6-8f90-5e3c506284bf", "name": "network-vif-plugged", "status": "completed", "tag": "e911730b-322f-4389-b750-fb1ba19cdb6a"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:08.908073 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-292ab105-53fd-4879-8f82-ba37f19c159d req-4c7eda58-f4b6-4ce3-9ae8-e0b06a14f738 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:08.908539 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-292ab105-53fd-4879-8f82-ba37f19c159d req-4c7eda58-f4b6-4ce3-9ae8-e0b06a14f738 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:08.921365 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-292ab105-53fd-4879-8f82-ba37f19c159d req-4c7eda58-f4b6-4ce3-9ae8-e0b06a14f738 service nova] Creating event network-vif-plugged:e911730b-322f-4389-b750-fb1ba19cdb6a for instance 7e036851-7855-49e6-8f90-5e3c506284bf on hv-cinder-79987 Jul 20 22:58:08.926486 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-292ab105-53fd-4879-8f82-ba37f19c159d req-4c7eda58-f4b6-4ce3-9ae8-e0b06a14f738 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038340 Jul 20 22:58:08.927304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 496/985] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:58:09.673404 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-5c0cee92-4cde-4c7c-89bf-e3bdd8f2fe19 req-2d075f49-3eaf-40cc-9777-430e9f904afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67b8fa1-b3a3-4778-86bd-b47c4351325e", "tag": "41607f00-87e1-4b7a-ab9d-322990f3e718"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:09.682486 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5c0cee92-4cde-4c7c-89bf-e3bdd8f2fe19 req-2d075f49-3eaf-40cc-9777-430e9f904afa service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:09.683003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5c0cee92-4cde-4c7c-89bf-e3bdd8f2fe19 req-2d075f49-3eaf-40cc-9777-430e9f904afa service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:09.696282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-5c0cee92-4cde-4c7c-89bf-e3bdd8f2fe19 req-2d075f49-3eaf-40cc-9777-430e9f904afa service nova] Creating event network-changed:41607f00-87e1-4b7a-ab9d-322990f3e718 for instance e67b8fa1-b3a3-4778-86bd-b47c4351325e on hv-cinder-79987 Jul 20 22:58:09.701299 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-5c0cee92-4cde-4c7c-89bf-e3bdd8f2fe19 req-2d075f49-3eaf-40cc-9777-430e9f904afa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043963 Jul 20 22:58:09.701883 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 490/986] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:58:09.779215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-343c7551-93ed-43b1-aa74-d5abfca1edaf tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:09.780045 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-343c7551-93ed-43b1-aa74-d5abfca1edaf tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:09.786633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-343c7551-93ed-43b1-aa74-d5abfca1edaf tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:09.787100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-343c7551-93ed-43b1-aa74-d5abfca1edaf tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:09.788846 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-343c7551-93ed-43b1-aa74-d5abfca1edaf tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:09.789285 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-343c7551-93ed-43b1-aa74-d5abfca1edaf tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:09.939798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-343c7551-93ed-43b1-aa74-d5abfca1edaf tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:09.947161 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-343c7551-93ed-43b1-aa74-d5abfca1edaf tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.172597 Jul 20 22:58:09.947740 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 497/987] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:09 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:10.964686 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-12812b60-6f5b-42b0-b512-491f145f185d tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:10.965392 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-12812b60-6f5b-42b0-b512-491f145f185d tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:10.972132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-12812b60-6f5b-42b0-b512-491f145f185d tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:10.979773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-12812b60-6f5b-42b0-b512-491f145f185d tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:10.979773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-12812b60-6f5b-42b0-b512-491f145f185d tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:10.979773 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-12812b60-6f5b-42b0-b512-491f145f185d tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:11.101417 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-12812b60-6f5b-42b0-b512-491f145f185d tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:11.108855 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-12812b60-6f5b-42b0-b512-491f145f185d tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1314 microversion: 2.1 time: 0.148368 Jul 20 22:58:11.109419 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 491/988] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:10 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:12.125570 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-50ba7890-24c6-4299-8c37-f0e5ff5a9442 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:12.126212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-50ba7890-24c6-4299-8c37-f0e5ff5a9442 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:12.128342 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:12.133257 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-50ba7890-24c6-4299-8c37-f0e5ff5a9442 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:12.140567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-50ba7890-24c6-4299-8c37-f0e5ff5a9442 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:12.140567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-50ba7890-24c6-4299-8c37-f0e5ff5a9442 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:12.140567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-50ba7890-24c6-4299-8c37-f0e5ff5a9442 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:12.273151 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-50ba7890-24c6-4299-8c37-f0e5ff5a9442 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:12.280708 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-50ba7890-24c6-4299-8c37-f0e5ff5a9442 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1498 microversion: 2.1 time: 0.158983 Jul 20 22:58:12.281290 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 498/989] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:12 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:13.152830 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-19ef727e-01d8-4a07-bd5c-63f7f1e949e4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:13.153346 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-19ef727e-01d8-4a07-bd5c-63f7f1e949e4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:13.155885 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:13.161349 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-19ef727e-01d8-4a07-bd5c-63f7f1e949e4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:13.165126 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-19ef727e-01d8-4a07-bd5c-63f7f1e949e4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:13.165126 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-19ef727e-01d8-4a07-bd5c-63f7f1e949e4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:13.165126 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-19ef727e-01d8-4a07-bd5c-63f7f1e949e4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:13.188188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-19ef727e-01d8-4a07-bd5c-63f7f1e949e4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:58:13.512717 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-19ef727e-01d8-4a07-bd5c-63f7f1e949e4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 204 len: 0 microversion: 2.1 time: 0.363273 Jul 20 22:58:13.513231 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 492/990] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:58:13 2022] DELETE /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:58:13.521883 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2996f7cf-ef12-4927-82ec-5d49deb940a4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:13.522489 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2996f7cf-ef12-4927-82ec-5d49deb940a4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:13.529125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2996f7cf-ef12-4927-82ec-5d49deb940a4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:13.529572 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2996f7cf-ef12-4927-82ec-5d49deb940a4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:13.530334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2996f7cf-ef12-4927-82ec-5d49deb940a4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:13.530769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2996f7cf-ef12-4927-82ec-5d49deb940a4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:13.662076 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2996f7cf-ef12-4927-82ec-5d49deb940a4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:13.669562 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2996f7cf-ef12-4927-82ec-5d49deb940a4 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1504 microversion: 2.1 time: 0.151977 Jul 20 22:58:13.670129 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 499/991] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:13 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:14.687958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b2e25d71-0ce2-42d8-a4b9-550918562348 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:14.688648 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b2e25d71-0ce2-42d8-a4b9-550918562348 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:14.695735 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b2e25d71-0ce2-42d8-a4b9-550918562348 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:14.696175 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b2e25d71-0ce2-42d8-a4b9-550918562348 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:14.696919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b2e25d71-0ce2-42d8-a4b9-550918562348 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:14.697345 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b2e25d71-0ce2-42d8-a4b9-550918562348 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:14.827918 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b2e25d71-0ce2-42d8-a4b9-550918562348 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:14.835507 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b2e25d71-0ce2-42d8-a4b9-550918562348 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1504 microversion: 2.1 time: 0.151702 Jul 20 22:58:14.836100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 493/992] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:14 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:15.852270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6ef07581-a274-4c15-a62a-2a811db82927 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:15.852908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6ef07581-a274-4c15-a62a-2a811db82927 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:15.859699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ef07581-a274-4c15-a62a-2a811db82927 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:15.860148 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ef07581-a274-4c15-a62a-2a811db82927 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:15.860908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ef07581-a274-4c15-a62a-2a811db82927 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:15.862242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ef07581-a274-4c15-a62a-2a811db82927 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:15.946536 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6ef07581-a274-4c15-a62a-2a811db82927 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:15.954237 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6ef07581-a274-4c15-a62a-2a811db82927 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 200 len: 1462 microversion: 2.1 time: 0.106132 Jul 20 22:58:15.955049 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 500/993] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:15 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 1462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:15.999612 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-5c940fc1-15ea-4513-b261-736e38e474de req-cd407580-076c-45c2-8c9d-c06aaff92ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e036851-7855-49e6-8f90-5e3c506284bf", "name": "network-vif-deleted", "tag": "e911730b-322f-4389-b750-fb1ba19cdb6a"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:16.008172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5c940fc1-15ea-4513-b261-736e38e474de req-cd407580-076c-45c2-8c9d-c06aaff92ed2 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:16.014116 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5c940fc1-15ea-4513-b261-736e38e474de req-cd407580-076c-45c2-8c9d-c06aaff92ed2 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:16.019740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-5c940fc1-15ea-4513-b261-736e38e474de req-cd407580-076c-45c2-8c9d-c06aaff92ed2 service nova] Creating event network-vif-deleted:e911730b-322f-4389-b750-fb1ba19cdb6a for instance 7e036851-7855-49e6-8f90-5e3c506284bf on hv-cinder-79987 Jul 20 22:58:16.024576 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-5c940fc1-15ea-4513-b261-736e38e474de req-cd407580-076c-45c2-8c9d-c06aaff92ed2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028619 Jul 20 22:58:16.025158 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 494/994] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:58:16.970661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:16.971292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: 7e036851-7855-49e6-8f90-5e3c506284bf] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:16.977953 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:16.978397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:16.979179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:16.979608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:16.993140 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] HTTP exception thrown: Instance 7e036851-7855-49e6-8f90-5e3c506284bf could not be found. Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Request method failure captured: Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf HTTP/1.1 Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IhwOaO6wP0PD9QvR4uXElM5n8of6oTd5qx3egrs5UR22zP737pjh_p6JmFn18eEqykcPOOfCHCy9J5w565jUVJRCMVgv7gtvzRjgw8mq_QdF5aLMeQ5gPepj0b1HH6689Ts45f00mxzqJoWXaz54Xw8KDdU0wxw9a42RYCrBj6evGk Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 2052ef42be464cc98e98aa5da24ee7ae Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-VolumesActionsTest-2020611047 Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 22:58:16.994780 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2052ef42be464cc98e98aa5da24ee7ae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2052ef42be464cc98e98aa5da24ee7ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2052ef42be464cc98e98aa5da24ee7ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2052ef42be464cc98e98aa5da24ee7ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-VolumesActionsTest-2020611047 Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 2052ef42be464cc98e98aa5da24ee7ae Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-VolumesActionsTest-2020611047 Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-VolumesActionsTest-2020611047-project Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: d8e921b8bae145aeb67fe1f1497c502e Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-VolumesActionsTest-2020611047-project Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 7e036851-7855-49e6-8f90-5e3c506284bf could not be found. Jul 20 22:58:16.996477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '7e036851-7855-49e6-8f90-5e3c506284bf'} Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e036851-7855-49e6-8f90-5e3c506284bf could not be found. Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:58:16.997483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e036851-7855-49e6-8f90-5e3c506284bf could not be found. Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e036851-7855-49e6-8f90-5e3c506284bf could not be found. Jul 20 22:58:16.999039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 22:58:17.000349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Returning 404 to user: Instance 7e036851-7855-49e6-8f90-5e3c506284bf could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:58:17.000349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b9cf3748-3c1f-4c3a-866d-a978a760c122 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf" status: 404 len: 111 microversion: 2.1 time: 0.029530 Jul 20 22:58:17.000349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 501/995] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:16 2022] GET /compute/v2.1/servers/7e036851-7855-49e6-8f90-5e3c506284bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:58:17.047523 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-427360511", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452", "networks": [{"uuid": "c86e9e7a-5907-4940-b6d7-ad82cb3693a8"}]}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:17.097614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] validate_networks() for [('c86e9e7a-5907-4940-b6d7-ad82cb3693a8', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:58:17.498318 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:58:17.498743 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:58:17.499261 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:58:17.499670 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:58:17.500102 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:58:17.508882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:17.509325 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:17.510110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:17.510800 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:17.527447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Getting quotas for project 2052ef42be464cc98e98aa5da24ee7ae. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:58:17.531354 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Getting quotas for user d8e921b8bae145aeb67fe1f1497c502e and project 2052ef42be464cc98e98aa5da24ee7ae. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:58:17.542520 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:58:17.544920 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:58:17.656869 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ab6a9ca3-e568-4d46-8652-fdbec90dc814 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613877 Jul 20 22:58:17.657513 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 495/996] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:58:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:58:17.667805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2a5035f2-c759-44ea-96ad-98ec99d318ae tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:17.668411 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2a5035f2-c759-44ea-96ad-98ec99d318ae tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:17.723134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2a5035f2-c759-44ea-96ad-98ec99d318ae tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:17.730600 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2a5035f2-c759-44ea-96ad-98ec99d318ae tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1213 microversion: 2.1 time: 0.066540 Jul 20 22:58:17.731192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 502/997] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:17 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:18.748825 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e4ea6cb1-5c37-463e-b8cb-97341625f897 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:18.749428 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e4ea6cb1-5c37-463e-b8cb-97341625f897 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:18.756524 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e4ea6cb1-5c37-463e-b8cb-97341625f897 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:18.756981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e4ea6cb1-5c37-463e-b8cb-97341625f897 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:18.757735 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e4ea6cb1-5c37-463e-b8cb-97341625f897 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:18.758132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e4ea6cb1-5c37-463e-b8cb-97341625f897 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:18.819214 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e4ea6cb1-5c37-463e-b8cb-97341625f897 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:18.826702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e4ea6cb1-5c37-463e-b8cb-97341625f897 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1217 microversion: 2.1 time: 0.082285 Jul 20 22:58:18.827291 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 496/998] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:18 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:19.844275 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c45db08b-ceaa-4c6b-9a6b-c26aeeb73310 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:19.844886 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c45db08b-ceaa-4c6b-9a6b-c26aeeb73310 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:19.854125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c45db08b-ceaa-4c6b-9a6b-c26aeeb73310 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:19.854577 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c45db08b-ceaa-4c6b-9a6b-c26aeeb73310 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:19.855379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c45db08b-ceaa-4c6b-9a6b-c26aeeb73310 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:19.856011 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c45db08b-ceaa-4c6b-9a6b-c26aeeb73310 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:19.935575 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c45db08b-ceaa-4c6b-9a6b-c26aeeb73310 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:19.943201 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c45db08b-ceaa-4c6b-9a6b-c26aeeb73310 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1273 microversion: 2.1 time: 0.102920 Jul 20 22:58:19.943998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 503/999] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:19 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:20.961160 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-81ff80f0-ec57-4b58-89fd-b91fd39ef027 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:20.961694 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-81ff80f0-ec57-4b58-89fd-b91fd39ef027 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:20.968344 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-81ff80f0-ec57-4b58-89fd-b91fd39ef027 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:20.968785 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-81ff80f0-ec57-4b58-89fd-b91fd39ef027 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:20.969536 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-81ff80f0-ec57-4b58-89fd-b91fd39ef027 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:20.969960 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-81ff80f0-ec57-4b58-89fd-b91fd39ef027 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:21.103003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-81ff80f0-ec57-4b58-89fd-b91fd39ef027 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:21.110509 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-81ff80f0-ec57-4b58-89fd-b91fd39ef027 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.153939 Jul 20 22:58:21.111093 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 497/1000] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:20 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:21.732597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-2e41eda8-7d87-45c3-93c3-c704a49d67eb req-c782135a-cb3b-40b3-9bcb-7dfc7cc7446d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e30566-52e2-4fc6-b508-01dfaa8fcc55", "tag": "e93feb73-bb2c-4df3-8317-1492c4e39d68"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:21.742075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-2e41eda8-7d87-45c3-93c3-c704a49d67eb req-c782135a-cb3b-40b3-9bcb-7dfc7cc7446d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:21.742603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-2e41eda8-7d87-45c3-93c3-c704a49d67eb req-c782135a-cb3b-40b3-9bcb-7dfc7cc7446d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:21.753609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-2e41eda8-7d87-45c3-93c3-c704a49d67eb req-c782135a-cb3b-40b3-9bcb-7dfc7cc7446d service nova] Creating event network-changed:e93feb73-bb2c-4df3-8317-1492c4e39d68 for instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 on hv-cinder-79987 Jul 20 22:58:21.759313 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-2e41eda8-7d87-45c3-93c3-c704a49d67eb req-c782135a-cb3b-40b3-9bcb-7dfc7cc7446d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038305 Jul 20 22:58:21.759900 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 504/1001] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:58:22.127179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-52dcf7a2-6368-47f2-97c1-16c88a4c3c99 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:22.127787 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-52dcf7a2-6368-47f2-97c1-16c88a4c3c99 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:22.134585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-52dcf7a2-6368-47f2-97c1-16c88a4c3c99 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:22.135490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-52dcf7a2-6368-47f2-97c1-16c88a4c3c99 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:22.136262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-52dcf7a2-6368-47f2-97c1-16c88a4c3c99 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:22.136696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-52dcf7a2-6368-47f2-97c1-16c88a4c3c99 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:22.273676 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-52dcf7a2-6368-47f2-97c1-16c88a4c3c99 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:22.281322 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-52dcf7a2-6368-47f2-97c1-16c88a4c3c99 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.157959 Jul 20 22:58:22.281882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 498/1002] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:22 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:23.299240 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8799a9c9-0127-4dbf-a0f2-7c51c0cc3c1a tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:23.299964 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8799a9c9-0127-4dbf-a0f2-7c51c0cc3c1a tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:23.306830 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8799a9c9-0127-4dbf-a0f2-7c51c0cc3c1a tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:23.307310 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8799a9c9-0127-4dbf-a0f2-7c51c0cc3c1a tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:23.308089 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8799a9c9-0127-4dbf-a0f2-7c51c0cc3c1a tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:23.308529 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8799a9c9-0127-4dbf-a0f2-7c51c0cc3c1a tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:23.439737 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8799a9c9-0127-4dbf-a0f2-7c51c0cc3c1a tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:23.447317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8799a9c9-0127-4dbf-a0f2-7c51c0cc3c1a tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.152719 Jul 20 22:58:23.447869 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 505/1003] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:23 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:24.464775 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2af91f03-7747-4f2e-abe1-a6a9f241e0b9 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:24.465346 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2af91f03-7747-4f2e-abe1-a6a9f241e0b9 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:24.471801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2af91f03-7747-4f2e-abe1-a6a9f241e0b9 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:24.472236 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2af91f03-7747-4f2e-abe1-a6a9f241e0b9 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:24.472977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2af91f03-7747-4f2e-abe1-a6a9f241e0b9 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:24.473448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2af91f03-7747-4f2e-abe1-a6a9f241e0b9 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:24.599964 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2af91f03-7747-4f2e-abe1-a6a9f241e0b9 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:24.607292 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2af91f03-7747-4f2e-abe1-a6a9f241e0b9 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.146514 Jul 20 22:58:24.607850 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 499/1004] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:24 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:25.624271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4b74c4be-1d5d-4fc0-975f-ae746487e398 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:25.624859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4b74c4be-1d5d-4fc0-975f-ae746487e398 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:25.631980 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4b74c4be-1d5d-4fc0-975f-ae746487e398 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:25.632433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4b74c4be-1d5d-4fc0-975f-ae746487e398 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:25.633194 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4b74c4be-1d5d-4fc0-975f-ae746487e398 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:25.633637 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4b74c4be-1d5d-4fc0-975f-ae746487e398 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:25.869249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4b74c4be-1d5d-4fc0-975f-ae746487e398 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:25.877543 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4b74c4be-1d5d-4fc0-975f-ae746487e398 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.257118 Jul 20 22:58:25.878320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 506/1005] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:25 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:58:26.185212 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-04097f57-6c15-4c41-9ce2-a1fff1dd5fb3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:26.185718 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-04097f57-6c15-4c41-9ce2-a1fff1dd5fb3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:26.187225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-acb6b413-8504-4629-95cb-08515df29af5 req-07fb1ee1-05cb-461d-bdd3-2362ea927961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7", "tag": "3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:26.196274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-acb6b413-8504-4629-95cb-08515df29af5 req-07fb1ee1-05cb-461d-bdd3-2362ea927961 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:26.199620 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-acb6b413-8504-4629-95cb-08515df29af5 req-07fb1ee1-05cb-461d-bdd3-2362ea927961 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:26.202234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04097f57-6c15-4c41-9ce2-a1fff1dd5fb3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:26.202689 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04097f57-6c15-4c41-9ce2-a1fff1dd5fb3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:26.203495 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04097f57-6c15-4c41-9ce2-a1fff1dd5fb3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:26.203925 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04097f57-6c15-4c41-9ce2-a1fff1dd5fb3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:26.207957 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-acb6b413-8504-4629-95cb-08515df29af5 req-07fb1ee1-05cb-461d-bdd3-2362ea927961 service nova] Creating event network-changed:3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf for instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 on hv-cinder-79987 Jul 20 22:58:26.213204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-acb6b413-8504-4629-95cb-08515df29af5 req-07fb1ee1-05cb-461d-bdd3-2362ea927961 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029621 Jul 20 22:58:26.214159 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 507/1006] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:58:26.232054 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-04097f57-6c15-4c41-9ce2-a1fff1dd5fb3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:58:26.541244 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-04097f57-6c15-4c41-9ce2-a1fff1dd5fb3 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "DELETE /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 204 len: 0 microversion: 2.1 time: 0.359717 Jul 20 22:58:26.542171 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 500/1007] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:58:26 2022] DELETE /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:58:26.550586 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-84cb2a71-fc5f-4213-bf4b-00c0857e1ed0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:26.552103 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-84cb2a71-fc5f-4213-bf4b-00c0857e1ed0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:26.558871 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-84cb2a71-fc5f-4213-bf4b-00c0857e1ed0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:26.559544 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-84cb2a71-fc5f-4213-bf4b-00c0857e1ed0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:26.560696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-84cb2a71-fc5f-4213-bf4b-00c0857e1ed0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:26.561132 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-84cb2a71-fc5f-4213-bf4b-00c0857e1ed0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:26.695199 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-84cb2a71-fc5f-4213-bf4b-00c0857e1ed0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:26.702772 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-84cb2a71-fc5f-4213-bf4b-00c0857e1ed0 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.156278 Jul 20 22:58:26.703511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 508/1008] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:26 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:26.896659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a07fe207-ee3c-4ac0-b460-7d5b96c4ceeb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:26.897274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a07fe207-ee3c-4ac0-b460-7d5b96c4ceeb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:26.903447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a07fe207-ee3c-4ac0-b460-7d5b96c4ceeb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:26.903893 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a07fe207-ee3c-4ac0-b460-7d5b96c4ceeb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:26.904650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a07fe207-ee3c-4ac0-b460-7d5b96c4ceeb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:26.905085 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a07fe207-ee3c-4ac0-b460-7d5b96c4ceeb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:27.037396 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a07fe207-ee3c-4ac0-b460-7d5b96c4ceeb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:27.044964 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a07fe207-ee3c-4ac0-b460-7d5b96c4ceeb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.153112 Jul 20 22:58:27.045537 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 501/1009] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:26 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:58:27.720320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2049ee13-d126-4e48-b563-2c9049458d73 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:27.721758 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2049ee13-d126-4e48-b563-2c9049458d73 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:27.727308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:27.729481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2049ee13-d126-4e48-b563-2c9049458d73 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:27.730005 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2049ee13-d126-4e48-b563-2c9049458d73 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:27.731032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2049ee13-d126-4e48-b563-2c9049458d73 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:27.731676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2049ee13-d126-4e48-b563-2c9049458d73 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:27.878664 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2049ee13-d126-4e48-b563-2c9049458d73 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:27.886827 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2049ee13-d126-4e48-b563-2c9049458d73 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1568 microversion: 2.1 time: 0.170658 Jul 20 22:58:27.887658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 509/1010] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:27 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:28.061602 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2987eaf3-1024-482c-bc1f-994678d97198 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:28.062214 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2987eaf3-1024-482c-bc1f-994678d97198 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:28.064696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:28.065360 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=6 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:28.070447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2987eaf3-1024-482c-bc1f-994678d97198 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:28.070893 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2987eaf3-1024-482c-bc1f-994678d97198 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:28.071683 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2987eaf3-1024-482c-bc1f-994678d97198 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:28.072119 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2987eaf3-1024-482c-bc1f-994678d97198 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:28.076307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:28.212443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2987eaf3-1024-482c-bc1f-994678d97198 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:28.219961 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2987eaf3-1024-482c-bc1f-994678d97198 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.162360 Jul 20 22:58:28.220634 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 502/1011] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:28 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:28.903978 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6a452547-7970-469d-934b-cdca5fc67292 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:28.904591 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6a452547-7970-469d-934b-cdca5fc67292 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:28.911734 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a452547-7970-469d-934b-cdca5fc67292 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:28.912189 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a452547-7970-469d-934b-cdca5fc67292 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:28.912970 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a452547-7970-469d-934b-cdca5fc67292 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:28.913405 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a452547-7970-469d-934b-cdca5fc67292 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:29.026419 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-180c6f5f-6c4b-4b0d-92f9-b5e00c80e14e req-f21ed25b-38e3-4242-9d8d-c547299b3d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e30566-52e2-4fc6-b508-01dfaa8fcc55", "name": "network-vif-plugged", "status": "completed", "tag": "e93feb73-bb2c-4df3-8317-1492c4e39d68"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:29.035996 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-180c6f5f-6c4b-4b0d-92f9-b5e00c80e14e req-f21ed25b-38e3-4242-9d8d-c547299b3d01 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:29.036444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-180c6f5f-6c4b-4b0d-92f9-b5e00c80e14e req-f21ed25b-38e3-4242-9d8d-c547299b3d01 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:29.050245 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-180c6f5f-6c4b-4b0d-92f9-b5e00c80e14e req-f21ed25b-38e3-4242-9d8d-c547299b3d01 service nova] Creating event network-vif-plugged:e93feb73-bb2c-4df3-8317-1492c4e39d68 for instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 on hv-cinder-79987 Jul 20 22:58:29.055731 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-180c6f5f-6c4b-4b0d-92f9-b5e00c80e14e req-f21ed25b-38e3-4242-9d8d-c547299b3d01 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033322 Jul 20 22:58:29.056330 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 503/1012] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 22:58:29.154135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6a452547-7970-469d-934b-cdca5fc67292 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:29.161686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6a452547-7970-469d-934b-cdca5fc67292 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1449 microversion: 2.1 time: 0.261726 Jul 20 22:58:29.162272 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 510/1013] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:28 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1449 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:29.239471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-78a5dc12-ae72-49a4-85a8-92b9f07b11ed tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:29.240287 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-78a5dc12-ae72-49a4-85a8-92b9f07b11ed tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:29.247872 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-78a5dc12-ae72-49a4-85a8-92b9f07b11ed tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:29.248668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-78a5dc12-ae72-49a4-85a8-92b9f07b11ed tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:29.249511 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-78a5dc12-ae72-49a4-85a8-92b9f07b11ed tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:29.250016 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-78a5dc12-ae72-49a4-85a8-92b9f07b11ed tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:29.381784 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-78a5dc12-ae72-49a4-85a8-92b9f07b11ed tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:29.389628 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-78a5dc12-ae72-49a4-85a8-92b9f07b11ed tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.155951 Jul 20 22:58:29.390193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 504/1014] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:29 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:58:29.561332 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-76278fa8-ee71-4013-9928-59999459986e req-040fc1ba-fb0f-441b-b9c5-acf8d0a98f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7", "name": "network-vif-deleted", "tag": "3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:29.569722 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-76278fa8-ee71-4013-9928-59999459986e req-040fc1ba-fb0f-441b-b9c5-acf8d0a98f8a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:29.574589 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-76278fa8-ee71-4013-9928-59999459986e req-040fc1ba-fb0f-441b-b9c5-acf8d0a98f8a service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:29.580798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-76278fa8-ee71-4013-9928-59999459986e req-040fc1ba-fb0f-441b-b9c5-acf8d0a98f8a service nova] Creating event network-vif-deleted:3c2611a7-8d9f-4aef-afbf-22d0b3b88cdf for instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 on hv-cinder-79987 Jul 20 22:58:29.585624 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-76278fa8-ee71-4013-9928-59999459986e req-040fc1ba-fb0f-441b-b9c5-acf8d0a98f8a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028034 Jul 20 22:58:29.586213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 511/1015] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:58:30.179565 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-04b6c687-feae-46ab-971e-876ee0f65854 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:30.180192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-04b6c687-feae-46ab-971e-876ee0f65854 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:30.186419 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04b6c687-feae-46ab-971e-876ee0f65854 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:30.189767 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04b6c687-feae-46ab-971e-876ee0f65854 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:30.189767 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04b6c687-feae-46ab-971e-876ee0f65854 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:30.189767 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-04b6c687-feae-46ab-971e-876ee0f65854 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:30.248742 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-04b6c687-feae-46ab-971e-876ee0f65854 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:30.256696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-04b6c687-feae-46ab-971e-876ee0f65854 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1219 microversion: 2.1 time: 0.081886 Jul 20 22:58:30.257276 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 505/1016] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:30 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:30.407411 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1c33d21e-781b-4c59-bef7-16b2e5dd72e6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:30.408056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1c33d21e-781b-4c59-bef7-16b2e5dd72e6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:30.414255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1c33d21e-781b-4c59-bef7-16b2e5dd72e6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:30.414699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1c33d21e-781b-4c59-bef7-16b2e5dd72e6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:30.415494 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1c33d21e-781b-4c59-bef7-16b2e5dd72e6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:30.415931 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1c33d21e-781b-4c59-bef7-16b2e5dd72e6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:30.546202 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1c33d21e-781b-4c59-bef7-16b2e5dd72e6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:30.553592 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1c33d21e-781b-4c59-bef7-16b2e5dd72e6 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1313 microversion: 2.1 time: 0.151014 Jul 20 22:58:30.554159 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 512/1017] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:30 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:31.273713 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f676827a-2abd-45bb-9f29-1db501f907dc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:31.274334 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f676827a-2abd-45bb-9f29-1db501f907dc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:31.280849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f676827a-2abd-45bb-9f29-1db501f907dc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:31.281305 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f676827a-2abd-45bb-9f29-1db501f907dc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:31.282064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f676827a-2abd-45bb-9f29-1db501f907dc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:31.282506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f676827a-2abd-45bb-9f29-1db501f907dc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:31.345259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f676827a-2abd-45bb-9f29-1db501f907dc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce4c02d3e314761ba613a802194b709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a257ecd598a74a5cb15fc4b62c5a5979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:31.353234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f676827a-2abd-45bb-9f29-1db501f907dc tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 200 len: 1219 microversion: 2.1 time: 0.083378 Jul 20 22:58:31.362461 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 506/1018] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:31 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:31.570275 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6ee336c3-78be-461c-b27d-309479ff16bb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:31.570883 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6ee336c3-78be-461c-b27d-309479ff16bb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:31.577364 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ee336c3-78be-461c-b27d-309479ff16bb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:31.579116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ee336c3-78be-461c-b27d-309479ff16bb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:31.579116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ee336c3-78be-461c-b27d-309479ff16bb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:31.579116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6ee336c3-78be-461c-b27d-309479ff16bb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:31.714018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6ee336c3-78be-461c-b27d-309479ff16bb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:31.721448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6ee336c3-78be-461c-b27d-309479ff16bb tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1498 microversion: 2.1 time: 0.155691 Jul 20 22:58:31.722022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 513/1019] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:31 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:32.370259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:32.370875 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] [instance: 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:32.377266 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:32.377702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:32.378512 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:32.378936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:32.392229 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] HTTP exception thrown: Instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 could not be found. Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Request method failure captured: Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 HTTP/1.1 Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IcoFL5vyVbLwhGzjwwK5M5qTtJ5Z-DcQwrhFhMzaSEi-O24AFiUPtipCU_mL4wuk-vCkNJCbTkxkvgNCvy4YEkCrCH1q8oYAbcEerdXj641fLAxrBqcqpT9B0AjlsZm2QefmK93OmXSbQu3yD7FbxMroR0JjLW9bpzmEkDVLvH5vy8 Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: a257ecd598a74a5cb15fc4b62c5a5979 Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-TestShelveInstance-1827406425 Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:58:32.393854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_a257ecd598a74a5cb15fc4b62c5a5979", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a257ecd598a74a5cb15fc4b62c5a5979"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/a257ecd598a74a5cb15fc4b62c5a5979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/a257ecd598a74a5cb15fc4b62c5a5979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-TestShelveInstance-1827406425 Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: a257ecd598a74a5cb15fc4b62c5a5979 Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-TestShelveInstance-1827406425 Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-TestShelveInstance-1827406425-project Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 3ce4c02d3e314761ba613a802194b709 Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-TestShelveInstance-1827406425-project Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 could not be found. Jul 20 22:58:32.395202 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7'} Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 could not be found. Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:58:32.396115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 could not be found. Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 could not be found. Jul 20 22:58:32.397597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:32.398929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Returning 404 to user: Instance 08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:58:32.398929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-989bed1e-33ac-4092-82d6-d65b55041104 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7" status: 404 len: 111 microversion: 2.1 time: 0.028866 Jul 20 22:58:32.398929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 507/1020] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:32 2022] GET /compute/v2.1/servers/08da5bbc-0bb6-4cf9-beb3-68a7e3d440f7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:58:32.630552 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ed53ed2a-42f8-42ae-89a7-82f17b7f3c0f tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:32.631070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ed53ed2a-42f8-42ae-89a7-82f17b7f3c0f tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:32.637623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed53ed2a-42f8-42ae-89a7-82f17b7f3c0f tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:32.638067 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed53ed2a-42f8-42ae-89a7-82f17b7f3c0f tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:32.638857 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed53ed2a-42f8-42ae-89a7-82f17b7f3c0f tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:32.639321 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ed53ed2a-42f8-42ae-89a7-82f17b7f3c0f tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:32.658455 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=100 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:32.660167 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8ca49f3c-9b68-449e-8aee-bd96d11cdf24 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] Calling method '.version_select at 0x7fe243de2dc0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:32.666443 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ed53ed2a-42f8-42ae-89a7-82f17b7f3c0f tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:58:32.765060 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8ca49f3c-9b68-449e-8aee-bd96d11cdf24 tempest-TestShelveInstance-1827406425 tempest-TestShelveInstance-1827406425-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-987704683" status: 202 len: 0 microversion: 2.1 time: 0.108554 Jul 20 22:58:32.765641 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 508/1021] 10.222.0.81 () {58 vars in 1250 bytes} [Wed Jul 20 22:58:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-987704683 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 22:58:33.021594 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ed53ed2a-42f8-42ae-89a7-82f17b7f3c0f tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 204 len: 0 microversion: 2.1 time: 0.394646 Jul 20 22:58:33.022103 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 514/1022] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:58:32 2022] DELETE /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:58:33.030294 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0c03af0f-f534-4ac4-b694-913810178d45 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:33.031058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0c03af0f-f534-4ac4-b694-913810178d45 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:33.037640 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0c03af0f-f534-4ac4-b694-913810178d45 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:33.038109 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0c03af0f-f534-4ac4-b694-913810178d45 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:33.038863 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0c03af0f-f534-4ac4-b694-913810178d45 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:33.039874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0c03af0f-f534-4ac4-b694-913810178d45 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:33.236761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0c03af0f-f534-4ac4-b694-913810178d45 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:33.244341 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0c03af0f-f534-4ac4-b694-913810178d45 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1504 microversion: 2.1 time: 0.217950 Jul 20 22:58:33.244912 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 509/1023] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:33 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:58:34.262002 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7618ac78-c04d-4650-aad1-1696c861d123 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:34.262727 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7618ac78-c04d-4650-aad1-1696c861d123 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:34.269425 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7618ac78-c04d-4650-aad1-1696c861d123 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:34.269872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7618ac78-c04d-4650-aad1-1696c861d123 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:34.271173 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7618ac78-c04d-4650-aad1-1696c861d123 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:34.271609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7618ac78-c04d-4650-aad1-1696c861d123 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:34.416700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7618ac78-c04d-4650-aad1-1696c861d123 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:34.424286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7618ac78-c04d-4650-aad1-1696c861d123 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1504 microversion: 2.1 time: 0.166744 Jul 20 22:58:34.430046 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 515/1024] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:34 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:35.441213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5d8e8a96-d760-4c9a-a39c-4e135e44cf3c tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:35.441927 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-5d8e8a96-d760-4c9a-a39c-4e135e44cf3c tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:35.448293 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d8e8a96-d760-4c9a-a39c-4e135e44cf3c tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:35.448823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d8e8a96-d760-4c9a-a39c-4e135e44cf3c tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:35.449483 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d8e8a96-d760-4c9a-a39c-4e135e44cf3c tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:35.449907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5d8e8a96-d760-4c9a-a39c-4e135e44cf3c tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:35.484341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-87d69124-ef3a-4f5d-bdc8-09db58032332 req-76b096a2-31c9-44c7-9830-111f7ddab51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e30566-52e2-4fc6-b508-01dfaa8fcc55", "name": "network-vif-deleted", "tag": "e93feb73-bb2c-4df3-8317-1492c4e39d68"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:58:35.509109 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-87d69124-ef3a-4f5d-bdc8-09db58032332 req-76b096a2-31c9-44c7-9830-111f7ddab51e service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:35.509689 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-87d69124-ef3a-4f5d-bdc8-09db58032332 req-76b096a2-31c9-44c7-9830-111f7ddab51e service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:35.522531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-87d69124-ef3a-4f5d-bdc8-09db58032332 req-76b096a2-31c9-44c7-9830-111f7ddab51e service nova] Creating event network-vif-deleted:e93feb73-bb2c-4df3-8317-1492c4e39d68 for instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 on hv-cinder-79987 Jul 20 22:58:35.527301 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-5d8e8a96-d760-4c9a-a39c-4e135e44cf3c tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:35.528182 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-87d69124-ef3a-4f5d-bdc8-09db58032332 req-76b096a2-31c9-44c7-9830-111f7ddab51e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048890 Jul 20 22:58:35.529086 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 516/1025] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:58:35.535098 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5d8e8a96-d760-4c9a-a39c-4e135e44cf3c tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1462 microversion: 2.1 time: 0.097764 Jul 20 22:58:35.536183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 510/1026] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:35 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:36.566257 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:36.566257 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:36.577612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:36.579779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:36.581037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:36.581691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:36.623516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:36.623964 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:36.624409 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lazy-loading 'fault' on Instance uuid c1e30566-52e2-4fc6-b508-01dfaa8fcc55 {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:58:36.693696 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e921b8bae145aeb67fe1f1497c502e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2052ef42be464cc98e98aa5da24ee7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:58:36.704048 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0361e719-dbe5-4246-b1ee-b8088d3148cd tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 200 len: 1303 microversion: 2.1 time: 0.151440 Jul 20 22:58:36.704048 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 517/1027] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:36 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:58:37.725191 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:58:37.725804 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] [instance: c1e30566-52e2-4fc6-b508-01dfaa8fcc55] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:58:37.732296 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:37.732741 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:37.733528 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:58:37.733962 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:58:37.747808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] HTTP exception thrown: Instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 could not be found. Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Request method failure captured: Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 HTTP/1.1 Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IhwOaO6wP0PD9QvR4uXElM5n8of6oTd5qx3egrs5UR22zP737pjh_p6JmFn18eEqykcPOOfCHCy9J5w565jUVJRCMVgv7gtvzRjgw8mq_QdF5aLMeQ5gPepj0b1HH6689Ts45f00mxzqJoWXaz54Xw8KDdU0wxw9a42RYCrBj6evGk Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 2052ef42be464cc98e98aa5da24ee7ae Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-VolumesActionsTest-2020611047 Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:58:37.749336 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2052ef42be464cc98e98aa5da24ee7ae", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2052ef42be464cc98e98aa5da24ee7ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2052ef42be464cc98e98aa5da24ee7ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2052ef42be464cc98e98aa5da24ee7ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-VolumesActionsTest-2020611047 Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 2052ef42be464cc98e98aa5da24ee7ae Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-VolumesActionsTest-2020611047 Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-VolumesActionsTest-2020611047-project Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: d8e921b8bae145aeb67fe1f1497c502e Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-VolumesActionsTest-2020611047-project Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 could not be found. Jul 20 22:58:37.751036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'c1e30566-52e2-4fc6-b508-01dfaa8fcc55'} Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 could not be found. Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:58:37.751861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 could not be found. Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 could not be found. Jul 20 22:58:37.753274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:58:37.754431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] Returning 404 to user: Instance c1e30566-52e2-4fc6-b508-01dfaa8fcc55 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:58:37.754431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e807644c-2260-4acd-82ad-51ccc4032e44 tempest-VolumesActionsTest-2020611047 tempest-VolumesActionsTest-2020611047-project] 10.222.0.81 "GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55" status: 404 len: 111 microversion: 2.1 time: 0.029932 Jul 20 22:58:37.754431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 511/1028] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:58:37 2022] GET /compute/v2.1/servers/c1e30566-52e2-4fc6-b508-01dfaa8fcc55 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 22:59:14.937148 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-821633622", "imageRef": "99373371-d27c-4de6-a0f9-3fdbd1a2b3c8", "flavorRef": "452"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:59:14.943304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:14.943958 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:14.987873 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] validate_networks() for None {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 22:59:15.257773 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 22:59:15.258190 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 22:59:15.258658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 22:59:15.259096 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 22:59:15.259507 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 22:59:15.268403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:15.268844 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:15.269631 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:15.270069 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:15.287394 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Getting quotas for project e78d1ca7276f47fb89822044d62ac720. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 22:59:15.291296 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Getting quotas for user 9242b67e7c0b4115ae4ffc8c37a12ea9 and project e78d1ca7276f47fb89822044d62ac720. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 22:59:15.302850 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 22:59:15.305088 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99373371-d27c-4de6-a0f9-3fdbd1a2b3c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 22:59:15.449569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-5b89394a-f074-4f0e-8663-310838ca7590 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516274 Jul 20 22:59:15.450134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 518/1029] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 22:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 22:59:15.460016 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-474c08bb-7ca4-47ac-bb55-bdbc91aeb171 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:15.460746 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-474c08bb-7ca4-47ac-bb55-bdbc91aeb171 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:15.462972 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:15.463668 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=40 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:15.515477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-474c08bb-7ca4-47ac-bb55-bdbc91aeb171 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:15.523490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-474c08bb-7ca4-47ac-bb55-bdbc91aeb171 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1214 microversion: 2.1 time: 0.067243 Jul 20 22:59:15.524185 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 512/1030] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:15 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:16.540404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d5026b5b-a949-4864-8491-bc0ea022e143 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:16.541002 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d5026b5b-a949-4864-8491-bc0ea022e143 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:16.547785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d5026b5b-a949-4864-8491-bc0ea022e143 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:16.548228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d5026b5b-a949-4864-8491-bc0ea022e143 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:16.549004 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d5026b5b-a949-4864-8491-bc0ea022e143 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:16.549437 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d5026b5b-a949-4864-8491-bc0ea022e143 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:16.611327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d5026b5b-a949-4864-8491-bc0ea022e143 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:16.619498 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d5026b5b-a949-4864-8491-bc0ea022e143 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1218 microversion: 2.1 time: 0.082932 Jul 20 22:59:16.620314 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 519/1031] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:16 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:17.636491 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c7046713-1191-4c1e-8462-0606ce6496b6 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:17.637104 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c7046713-1191-4c1e-8462-0606ce6496b6 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:17.647992 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c7046713-1191-4c1e-8462-0606ce6496b6 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:17.648444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c7046713-1191-4c1e-8462-0606ce6496b6 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:17.649211 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c7046713-1191-4c1e-8462-0606ce6496b6 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:17.649646 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c7046713-1191-4c1e-8462-0606ce6496b6 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:17.718260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c7046713-1191-4c1e-8462-0606ce6496b6 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:17.726523 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c7046713-1191-4c1e-8462-0606ce6496b6 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1274 microversion: 2.1 time: 0.094332 Jul 20 22:59:17.727622 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 513/1032] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:17 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:18.749392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d469339c-4dec-46dc-88bc-a47e4b56dbb8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:18.750282 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d469339c-4dec-46dc-88bc-a47e4b56dbb8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:18.757225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d469339c-4dec-46dc-88bc-a47e4b56dbb8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:18.757669 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d469339c-4dec-46dc-88bc-a47e4b56dbb8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:18.758434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d469339c-4dec-46dc-88bc-a47e4b56dbb8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:18.758898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d469339c-4dec-46dc-88bc-a47e4b56dbb8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:18.905618 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d469339c-4dec-46dc-88bc-a47e4b56dbb8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:18.914104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d469339c-4dec-46dc-88bc-a47e4b56dbb8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1314 microversion: 2.1 time: 0.168689 Jul 20 22:59:18.914638 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 520/1033] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:18 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:19.695509 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-b7f68200-b283-496e-951e-9906ac802fc0 req-013aa098-1e43-40f4-af61-6b05655d6b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a394037-8bb5-4deb-90da-f2bc0953dcd1", "tag": "d812e939-076b-4a98-8b0b-39d158dd9f5e"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:59:19.704384 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-b7f68200-b283-496e-951e-9906ac802fc0 req-013aa098-1e43-40f4-af61-6b05655d6b46 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:19.705207 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-b7f68200-b283-496e-951e-9906ac802fc0 req-013aa098-1e43-40f4-af61-6b05655d6b46 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:19.718854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-b7f68200-b283-496e-951e-9906ac802fc0 req-013aa098-1e43-40f4-af61-6b05655d6b46 service nova] Creating event network-changed:d812e939-076b-4a98-8b0b-39d158dd9f5e for instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 on hv-cinder-79987 Jul 20 22:59:19.724118 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-b7f68200-b283-496e-951e-9906ac802fc0 req-013aa098-1e43-40f4-af61-6b05655d6b46 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033999 Jul 20 22:59:19.724929 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 514/1034] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:59:19.931815 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-51b61283-9c72-45a9-a67d-f523745eeff8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:19.932491 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-51b61283-9c72-45a9-a67d-f523745eeff8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:19.938907 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51b61283-9c72-45a9-a67d-f523745eeff8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:19.939630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51b61283-9c72-45a9-a67d-f523745eeff8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:19.940592 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51b61283-9c72-45a9-a67d-f523745eeff8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:19.941030 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51b61283-9c72-45a9-a67d-f523745eeff8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:20.137977 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-51b61283-9c72-45a9-a67d-f523745eeff8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:20.146714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-51b61283-9c72-45a9-a67d-f523745eeff8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1314 microversion: 2.1 time: 0.218681 Jul 20 22:59:20.147322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 521/1035] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:19 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:21.164573 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f6db4b39-f192-45a3-b798-3bc5369b65c8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:21.165263 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f6db4b39-f192-45a3-b798-3bc5369b65c8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:21.171510 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f6db4b39-f192-45a3-b798-3bc5369b65c8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:21.171958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f6db4b39-f192-45a3-b798-3bc5369b65c8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:21.172712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f6db4b39-f192-45a3-b798-3bc5369b65c8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:21.173145 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f6db4b39-f192-45a3-b798-3bc5369b65c8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:21.300706 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f6db4b39-f192-45a3-b798-3bc5369b65c8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:21.308127 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f6db4b39-f192-45a3-b798-3bc5369b65c8 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1314 microversion: 2.1 time: 0.148245 Jul 20 22:59:21.308679 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 515/1036] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:21 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:22.324717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b7fc736d-2736-42ca-a03c-ad9df84449aa tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:22.325328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b7fc736d-2736-42ca-a03c-ad9df84449aa tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:22.331839 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7fc736d-2736-42ca-a03c-ad9df84449aa tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:22.332283 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7fc736d-2736-42ca-a03c-ad9df84449aa tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:22.333039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7fc736d-2736-42ca-a03c-ad9df84449aa tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:22.333475 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b7fc736d-2736-42ca-a03c-ad9df84449aa tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:22.463860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b7fc736d-2736-42ca-a03c-ad9df84449aa tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:22.471223 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b7fc736d-2736-42ca-a03c-ad9df84449aa tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1314 microversion: 2.1 time: 0.150268 Jul 20 22:59:22.471786 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 522/1037] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:22 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:23.489257 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e7d55914-7511-4339-b604-fbf803badf33 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:23.489792 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e7d55914-7511-4339-b604-fbf803badf33 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:23.496209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7d55914-7511-4339-b604-fbf803badf33 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:23.496659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7d55914-7511-4339-b604-fbf803badf33 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:23.497462 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7d55914-7511-4339-b604-fbf803badf33 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:23.497901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7d55914-7511-4339-b604-fbf803badf33 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:23.627487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e7d55914-7511-4339-b604-fbf803badf33 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:23.635695 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e7d55914-7511-4339-b604-fbf803badf33 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1314 microversion: 2.1 time: 0.150760 Jul 20 22:59:23.636262 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 516/1038] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:23 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:24.652459 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-44a88dbd-2c6c-4967-b495-3b3129c83b06 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:24.653070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-44a88dbd-2c6c-4967-b495-3b3129c83b06 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:24.659483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-44a88dbd-2c6c-4967-b495-3b3129c83b06 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:24.659929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-44a88dbd-2c6c-4967-b495-3b3129c83b06 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:24.661292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-44a88dbd-2c6c-4967-b495-3b3129c83b06 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:24.661728 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-44a88dbd-2c6c-4967-b495-3b3129c83b06 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:24.796848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-44a88dbd-2c6c-4967-b495-3b3129c83b06 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:24.804839 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-44a88dbd-2c6c-4967-b495-3b3129c83b06 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1314 microversion: 2.1 time: 0.156221 Jul 20 22:59:24.805392 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 523/1039] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:24 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:25.821772 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3011d8fa-b455-4ea5-b3c9-36d16e00ffb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:25.824564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3011d8fa-b455-4ea5-b3c9-36d16e00ffb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:25.824895 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:25.826060 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-0e240607-de54-44b4-832e-0146f2768583 req-0d2f517d-1b4b-4383-83ed-3a6f190f0521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a394037-8bb5-4deb-90da-f2bc0953dcd1", "name": "network-vif-plugged", "status": "completed", "tag": "d812e939-076b-4a98-8b0b-39d158dd9f5e"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:59:25.830320 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3011d8fa-b455-4ea5-b3c9-36d16e00ffb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:25.830490 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:25.830829 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3011d8fa-b455-4ea5-b3c9-36d16e00ffb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:25.831409 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=6 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:25.831649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3011d8fa-b455-4ea5-b3c9-36d16e00ffb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:25.832087 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3011d8fa-b455-4ea5-b3c9-36d16e00ffb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:25.837183 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-0e240607-de54-44b4-832e-0146f2768583 req-0d2f517d-1b4b-4383-83ed-3a6f190f0521 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:25.837617 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-0e240607-de54-44b4-832e-0146f2768583 req-0d2f517d-1b4b-4383-83ed-3a6f190f0521 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:25.849341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-0e240607-de54-44b4-832e-0146f2768583 req-0d2f517d-1b4b-4383-83ed-3a6f190f0521 service nova] Creating event network-vif-plugged:d812e939-076b-4a98-8b0b-39d158dd9f5e for instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 on hv-cinder-79987 Jul 20 22:59:25.854829 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-0e240607-de54-44b4-832e-0146f2768583 req-0d2f517d-1b4b-4383-83ed-3a6f190f0521 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033095 Jul 20 22:59:25.855559 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 524/1040] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:59:25.968927 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3011d8fa-b455-4ea5-b3c9-36d16e00ffb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:25.977143 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3011d8fa-b455-4ea5-b3c9-36d16e00ffb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1314 microversion: 2.1 time: 0.159310 Jul 20 22:59:25.977702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 517/1041] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:25 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:26.994114 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0fa75111-4663-4512-9680-75a5e6a5bdec tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:26.994812 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0fa75111-4663-4512-9680-75a5e6a5bdec tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:27.002438 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0fa75111-4663-4512-9680-75a5e6a5bdec tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:27.002885 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0fa75111-4663-4512-9680-75a5e6a5bdec tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:27.003688 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0fa75111-4663-4512-9680-75a5e6a5bdec tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:27.004127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0fa75111-4663-4512-9680-75a5e6a5bdec tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:27.144179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0fa75111-4663-4512-9680-75a5e6a5bdec tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:27.152179 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0fa75111-4663-4512-9680-75a5e6a5bdec tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1314 microversion: 2.1 time: 0.162254 Jul 20 22:59:27.152729 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 525/1042] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:26 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:28.069198 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e53ad426-8bf3-4218-b779-a483283451ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:28.069693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e53ad426-8bf3-4218-b779-a483283451ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:28.075778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e53ad426-8bf3-4218-b779-a483283451ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:28.076218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e53ad426-8bf3-4218-b779-a483283451ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:28.077555 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e53ad426-8bf3-4218-b779-a483283451ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:28.077990 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e53ad426-8bf3-4218-b779-a483283451ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:28.101786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e53ad426-8bf3-4218-b779-a483283451ef tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/ips" status: 200 len: 151 microversion: 2.20 time: 0.198297 Jul 20 22:59:28.102317 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 518/1043] 10.222.0.81 () {60 vars in 1288 bytes} [Wed Jul 20 22:59:27 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/ips => generated 151 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 22:59:28.169859 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-996c9104-8382-494e-82d8-989787d2c7ba tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:28.170391 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-996c9104-8382-494e-82d8-989787d2c7ba tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:28.177702 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-996c9104-8382-494e-82d8-989787d2c7ba tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:28.178148 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-996c9104-8382-494e-82d8-989787d2c7ba tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:28.185251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-996c9104-8382-494e-82d8-989787d2c7ba tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:28.185251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-996c9104-8382-494e-82d8-989787d2c7ba tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:28.317358 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-996c9104-8382-494e-82d8-989787d2c7ba tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:28.326246 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-996c9104-8382-494e-82d8-989787d2c7ba tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1463 microversion: 2.1 time: 0.161001 Jul 20 22:59:28.326991 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 526/1044] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:28 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 22:59:28.367232 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4ed43328-0c1b-43ff-a8d6-55b2f56ac785 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:28.370050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4ed43328-0c1b-43ff-a8d6-55b2f56ac785 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:28.373803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4ed43328-0c1b-43ff-a8d6-55b2f56ac785 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:28.374256 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4ed43328-0c1b-43ff-a8d6-55b2f56ac785 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:28.375027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4ed43328-0c1b-43ff-a8d6-55b2f56ac785 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:28.375470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4ed43328-0c1b-43ff-a8d6-55b2f56ac785 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:28.401295 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4ed43328-0c1b-43ff-a8d6-55b2f56ac785 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 22:59:28.687691 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4ed43328-0c1b-43ff-a8d6-55b2f56ac785 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 204 len: 0 microversion: 2.1 time: 0.321039 Jul 20 22:59:28.687691 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 519/1045] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 22:59:28 2022] DELETE /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:59:28.694636 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c921fbb1-e94c-4dd0-a1c3-e1f12b10ecd5 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:28.695352 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c921fbb1-e94c-4dd0-a1c3-e1f12b10ecd5 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:28.701420 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c921fbb1-e94c-4dd0-a1c3-e1f12b10ecd5 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:28.701949 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c921fbb1-e94c-4dd0-a1c3-e1f12b10ecd5 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:28.702637 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c921fbb1-e94c-4dd0-a1c3-e1f12b10ecd5 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:28.703097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c921fbb1-e94c-4dd0-a1c3-e1f12b10ecd5 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:28.838220 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c921fbb1-e94c-4dd0-a1c3-e1f12b10ecd5 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:28.849811 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c921fbb1-e94c-4dd0-a1c3-e1f12b10ecd5 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1469 microversion: 2.1 time: 0.158943 Jul 20 22:59:28.850400 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 527/1046] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:28 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:29.870723 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f25473ef-b3d5-48e6-ab19-5d3b5a4b443b tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:29.871448 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f25473ef-b3d5-48e6-ab19-5d3b5a4b443b tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:29.887696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f25473ef-b3d5-48e6-ab19-5d3b5a4b443b tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:29.887696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f25473ef-b3d5-48e6-ab19-5d3b5a4b443b tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:29.887696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f25473ef-b3d5-48e6-ab19-5d3b5a4b443b tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:29.887696 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f25473ef-b3d5-48e6-ab19-5d3b5a4b443b tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:30.021962 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f25473ef-b3d5-48e6-ab19-5d3b5a4b443b tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:30.029439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f25473ef-b3d5-48e6-ab19-5d3b5a4b443b tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1469 microversion: 2.1 time: 0.164382 Jul 20 22:59:30.030004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 520/1047] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:29 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:31.045700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6e3f23da-653c-4a69-8a66-159298eda903 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:31.048142 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6e3f23da-653c-4a69-8a66-159298eda903 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:31.057213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e3f23da-653c-4a69-8a66-159298eda903 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:31.057868 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e3f23da-653c-4a69-8a66-159298eda903 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:31.058649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e3f23da-653c-4a69-8a66-159298eda903 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:31.059099 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6e3f23da-653c-4a69-8a66-159298eda903 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:31.062667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-3a2827c9-1179-421d-87c4-23ef5099b083 req-be992171-e470-416a-b947-9f6fa1e4df46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a394037-8bb5-4deb-90da-f2bc0953dcd1", "name": "network-vif-deleted", "tag": "d812e939-076b-4a98-8b0b-39d158dd9f5e"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:59:31.090600 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-3a2827c9-1179-421d-87c4-23ef5099b083 req-be992171-e470-416a-b947-9f6fa1e4df46 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:31.090600 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-3a2827c9-1179-421d-87c4-23ef5099b083 req-be992171-e470-416a-b947-9f6fa1e4df46 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:31.090600 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-3a2827c9-1179-421d-87c4-23ef5099b083 req-be992171-e470-416a-b947-9f6fa1e4df46 service nova] Creating event network-vif-deleted:d812e939-076b-4a98-8b0b-39d158dd9f5e for instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 on hv-cinder-79987 Jul 20 22:59:31.092025 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-3a2827c9-1179-421d-87c4-23ef5099b083 req-be992171-e470-416a-b947-9f6fa1e4df46 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033229 Jul 20 22:59:31.092721 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 521/1048] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:59:31.129853 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6e3f23da-653c-4a69-8a66-159298eda903 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:31.138508 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6e3f23da-653c-4a69-8a66-159298eda903 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1427 microversion: 2.1 time: 0.096205 Jul 20 22:59:31.139234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 528/1049] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:31 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:31.386589 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e8e29674-0872-4a63-aa6f-8925c38380c0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:59:31.387141 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e8e29674-0872-4a63-aa6f-8925c38380c0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:31.393444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8e29674-0872-4a63-aa6f-8925c38380c0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:31.393891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8e29674-0872-4a63-aa6f-8925c38380c0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:31.399968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8e29674-0872-4a63-aa6f-8925c38380c0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:31.399968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8e29674-0872-4a63-aa6f-8925c38380c0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:31.418535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-e8e29674-0872-4a63-aa6f-8925c38380c0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lazy-loading 'flavor' on Instance uuid e67b8fa1-b3a3-4778-86bd-b47c4351325e {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:59:32.076907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e8e29674-0872-4a63-aa6f-8925c38380c0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/action" status: 202 len: 0 microversion: 2.20 time: 0.694991 Jul 20 22:59:32.077567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 522/1050] 10.222.0.81 () {62 vars in 1318 bytes} [Wed Jul 20 22:59:31 2022] POST /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/action => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 22:59:32.085912 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:32.086547 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:32.093118 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:32.093558 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:32.094315 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:32.094920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:32.156137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:32.156928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:32.163792 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:32.164330 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:32.165189 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:32.165746 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:32.203058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:32.203515 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:32.203971 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lazy-loading 'fault' on Instance uuid 3a394037-8bb5-4deb-90da-f2bc0953dcd1 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 22:59:32.239817 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:32.249127 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:32.250853 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:32.252050 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-542d8694-c598-4504-89cf-bbc088da60fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.170081 Jul 20 22:59:32.252864 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 529/1051] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:32 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:32.255826 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9242b67e7c0b4115ae4ffc8c37a12ea9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78d1ca7276f47fb89822044d62ac720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:32.264023 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6706f4d0-a3f3-465e-bdf8-416b63f32fb2 tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 200 len: 1304 microversion: 2.1 time: 0.112428 Jul 20 22:59:32.264597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 523/1052] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:32 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 22:59:33.275156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:33.275766 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:33.281549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:33.282170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] [instance: 3a394037-8bb5-4deb-90da-f2bc0953dcd1] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:33.282380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:33.282831 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:33.283633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:33.284069 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:33.288143 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:33.288596 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:33.289490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:33.289931 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:33.303610 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] HTTP exception thrown: Instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 could not be found. Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Request method failure captured: Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 HTTP/1.1 Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2Ii_gaNa5n-6mOtz3I-rvVQ0fdQ370PFFArKrKA0XpQLy52H4rzmqyJYslIqKI8WdSASSXTqOTQHg7NAG4vbN8LaNSj79aOnMXz5FVsxWMxW6Ugy49SjRMbgmgKLRIizKSFAkflxb7FOyNQShgtLUkZFD0r9FD8sqKIc9cRdzbG_p3A Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: e78d1ca7276f47fb89822044d62ac720 Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-VolumesNegativeTest-1234207236 Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 22:59:33.305283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e78d1ca7276f47fb89822044d62ac720", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e78d1ca7276f47fb89822044d62ac720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e78d1ca7276f47fb89822044d62ac720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e78d1ca7276f47fb89822044d62ac720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-VolumesNegativeTest-1234207236 Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: e78d1ca7276f47fb89822044d62ac720 Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-VolumesNegativeTest-1234207236 Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-VolumesNegativeTest-1234207236-project Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 9242b67e7c0b4115ae4ffc8c37a12ea9 Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-VolumesNegativeTest-1234207236-project Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 could not be found. Jul 20 22:59:33.306908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '3a394037-8bb5-4deb-90da-f2bc0953dcd1'} Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 could not be found. Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 22:59:33.307790 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 could not be found. Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 could not be found. Jul 20 22:59:33.309099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 22:59:33.310379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] Returning 404 to user: Instance 3a394037-8bb5-4deb-90da-f2bc0953dcd1 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 22:59:33.310379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-022a26ce-d33b-4896-a82c-039aa40d62fb tempest-VolumesNegativeTest-1234207236 tempest-VolumesNegativeTest-1234207236-project] 10.222.0.81 "GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1" status: 404 len: 111 microversion: 2.1 time: 0.029118 Jul 20 22:59:33.310379 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 524/1053] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 22:59:33 2022] GET /compute/v2.1/servers/3a394037-8bb5-4deb-90da-f2bc0953dcd1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 22:59:33.418108 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:33.426181 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:33.427712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:33.428869 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-225046b0-268e-4116-93ad-342eb62abf02 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.157615 Jul 20 22:59:33.429665 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 530/1054] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:33 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:34.446549 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:34.449620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:34.458761 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:34.459480 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:34.460239 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:34.460691 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:34.596576 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:34.604783 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:34.606432 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:34.607676 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7adc3330-5010-41ee-8386-254ee1f4dd19 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.165092 Jul 20 22:59:34.608218 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 525/1055] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:34 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:35.625996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:35.626671 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:35.633314 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:35.633756 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:35.634567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:35.634996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:35.764296 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:35.772904 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:35.778552 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:35.778552 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-87be090e-dff9-4f60-81bb-be9c3df20918 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.153676 Jul 20 22:59:35.778552 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 531/1056] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:35 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:36.793591 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:36.794105 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:36.801031 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:36.801492 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:36.802263 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:36.802700 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:36.939401 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:36.947952 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:36.949477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:36.950645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9293ba07-7ce0-4892-a886-5aaa6d21f422 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.161023 Jul 20 22:59:36.951263 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 526/1057] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:36 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:37.969580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:37.970186 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:37.977030 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:37.977469 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:37.978229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:37.978651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:38.109728 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:38.118090 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:38.119624 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:38.120777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0bd7b390-8822-4565-8d7c-8027575def3d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.155090 Jul 20 22:59:38.121328 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 532/1058] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:37 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:39.138831 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:39.139460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:39.146629 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:39.147102 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:39.147876 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:39.148307 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:39.290739 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:39.294377 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:39.299138 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:39.301418 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:39.302547 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-79f0436c-28fc-4ab3-9e5a-579585530caa tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.167908 Jul 20 22:59:39.303117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 527/1059] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:39 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:40.320856 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:40.321464 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:40.327674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:40.328120 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:40.328873 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:40.329313 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:40.457707 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:40.465574 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:40.467134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:40.468286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-84fe701d-0080-4fe3-a557-f2b8dee1cf64 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.151350 Jul 20 22:59:40.468841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 533/1060] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:40 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:41.485969 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:41.486534 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:41.493701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:41.494156 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:41.494919 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:41.495385 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:41.626293 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:41.634743 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:41.636546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:41.637691 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-0451a2ae-db86-42c5-af29-a22843dc576f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.155780 Jul 20 22:59:41.638243 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 528/1061] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:41 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:42.656533 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:42.657125 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:42.664658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:42.665129 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:42.665878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:42.666306 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:42.801302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:42.809080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:42.810569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:42.811755 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-51dd0938-8577-4076-9ec2-90e78f2b1b76 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.159176 Jul 20 22:59:42.812314 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 534/1062] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:42 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:43.829824 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:43.830439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:43.837585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:43.838033 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:43.838791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:43.839253 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:43.967578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:43.975481 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:43.976986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:43.978140 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ae5ee607-139e-418b-99a1-a681c44c1c5d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.152190 Jul 20 22:59:43.978699 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 529/1063] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:43 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:44.996740 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:44.997400 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:45.003883 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:45.004334 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:45.005103 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:45.005540 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:45.136080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:45.138318 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=99 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:45.145193 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:45.146795 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:45.147998 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6bf446c2-8a98-4436-8a10-8ba92c265fed tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.155223 Jul 20 22:59:45.157872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 535/1064] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:44 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:46.165647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:46.166271 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:46.172715 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:46.175632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:46.175632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:46.175632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:46.304713 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:46.312600 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:46.314129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:46.315302 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9e18ad3e-3ea8-4802-91bc-92d3e4b6523d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.153522 Jul 20 22:59:46.315849 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 530/1065] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:46 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:47.334830 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:47.335460 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:47.338013 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:47.342735 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:47.343219 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:47.343972 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:47.344405 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:47.472159 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:47.480003 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:47.481489 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:47.482629 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b05652b3-a752-42aa-b368-a21fceb03272 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.152235 Jul 20 22:59:47.483209 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 536/1066] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:47 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:48.500950 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:48.537409 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:48.537409 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:48.537409 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:48.537409 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:48.537822 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:48.639897 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:48.648966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:48.650476 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:48.651671 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ebe4f48a-b2a5-4aa0-b48e-5998b1eeae53 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.154898 Jul 20 22:59:48.652226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 531/1067] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:48 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:49.669604 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:49.670215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:49.677527 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:49.677975 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:49.678743 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:49.679210 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:49.810792 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:49.818881 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:49.820402 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:49.821557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-49480661-1f43-4882-9f0a-71897c079a83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1744 microversion: 2.20 time: 0.155848 Jul 20 22:59:49.822118 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 537/1068] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:49 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:50.840682 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:50.841286 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:50.843588 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:50.848435 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:50.848887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:50.849650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:50.850637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:50.979182 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:50.987067 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:50.988579 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:50.989730 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6083244a-6c85-4d9d-822d-e80217640b49 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1744 microversion: 2.20 time: 0.152968 Jul 20 22:59:50.990284 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 532/1069] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:50 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:51.873450 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-9102f82b-d528-4859-ad80-b6b44758ec5d req-bafbd35c-de03-48a9-80d2-88b3aef4113f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67b8fa1-b3a3-4778-86bd-b47c4351325e", "name": "network-vif-plugged", "status": "completed", "tag": "41607f00-87e1-4b7a-ab9d-322990f3e718"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 22:59:51.882498 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-9102f82b-d528-4859-ad80-b6b44758ec5d req-bafbd35c-de03-48a9-80d2-88b3aef4113f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:51.890291 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-9102f82b-d528-4859-ad80-b6b44758ec5d req-bafbd35c-de03-48a9-80d2-88b3aef4113f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:51.895160 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-9102f82b-d528-4859-ad80-b6b44758ec5d req-bafbd35c-de03-48a9-80d2-88b3aef4113f service nova] Creating event network-vif-plugged:41607f00-87e1-4b7a-ab9d-322990f3e718 for instance e67b8fa1-b3a3-4778-86bd-b47c4351325e on hv-cinder-79987 Jul 20 22:59:51.900210 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-9102f82b-d528-4859-ad80-b6b44758ec5d req-bafbd35c-de03-48a9-80d2-88b3aef4113f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030427 Jul 20 22:59:51.900812 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 538/1070] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 22:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 22:59:52.007486 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:52.008099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:52.014927 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:52.015407 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:52.016172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:52.016641 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:52.152645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:52.161206 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:52.162873 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:52.164102 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6d2c7993-28ff-4e5d-b072-7ded3d25465a tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1744 microversion: 2.20 time: 0.161216 Jul 20 22:59:52.164662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 533/1071] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:52 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:53.182865 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:53.183587 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:53.190320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:53.190761 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:53.191626 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:53.192057 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:53.319559 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:53.327299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:53.328793 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:53.329940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-81a573ce-aea3-4e50-866d-6169d0e5c184 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1744 microversion: 2.20 time: 0.151369 Jul 20 22:59:53.330498 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 539/1072] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:53 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:54.348928 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:54.349532 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:54.356428 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:54.356874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:54.357632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:54.358092 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:54.486750 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:54.495494 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:54.496986 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:54.498130 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6aa79c30-246f-4ed4-bbf4-007235058ce9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.153531 Jul 20 22:59:54.498684 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 534/1073] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:54 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:55.525098 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:55.525646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:55.533227 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:55.533668 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:55.534425 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:55.535510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:55.698898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:55.708581 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:55.710079 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:55.711292 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0dbc2b64-f678-4677-9c70-e503728aa8a0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.193374 Jul 20 22:59:55.722476 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 540/1074] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:55 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:56.730977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:56.732352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:56.742348 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:56.743557 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:56.744330 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:56.744760 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:56.898023 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:56.907726 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:56.909266 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:56.911149 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-88def819-f63a-401d-bccf-2bf6595085d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.185562 Jul 20 22:59:56.911981 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 535/1075] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:56 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:57.930634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:57.931393 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:57.940300 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:57.941260 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:57.942035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:57.942562 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:58.111676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:58.120607 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:58.122643 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:58.124612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b911e067-c218-49fd-882d-2c53a30830d2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.198246 Jul 20 22:59:58.125542 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 541/1076] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:57 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 22:59:59.146411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 22:59:59.147905 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 22:59:59.156783 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:59.157238 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:59.158026 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 22:59:59.158455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 22:59:59.303553 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:59.311898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:59.313703 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 22:59:59.314852 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-925d15df-37c2-4af4-85cb-cda5f4233779 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.173046 Jul 20 22:59:59.327209 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 536/1077] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 22:59:59 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:00.338043 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:00.338743 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:00.345268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:00.345712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:00.346472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:00.346905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:00.478384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:00.486524 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:00.488553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:00.489700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ab435514-61b3-4ab8-beb5-16bafb31e51c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.155552 Jul 20 23:00:00.490262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 542/1078] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:00 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:01.509443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:01.510244 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:01.516889 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:01.517345 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:01.518112 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:01.518551 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:01.683710 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:01.692231 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:01.694148 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:01.695571 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d6750e68-0fda-4503-ab92-a2fcc30f2231 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.190131 Jul 20 23:00:01.696134 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 537/1079] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:01 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:02.717175 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:02.718528 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:02.725850 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:02.726431 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:02.727369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:02.727889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:02.886447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:02.898864 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:02.900452 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:02.901550 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8befdc4d-2bea-4b95-a4f4-e36bcef8daa7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.189227 Jul 20 23:00:02.902421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 543/1080] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:02 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:03.920807 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:03.921564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:03.931714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:03.931714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:03.931714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:03.931714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:04.077411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:04.085652 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:04.087198 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:04.088365 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e32bf804-4db6-4297-b999-58a1afc2c27f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.171927 Jul 20 23:00:04.089133 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 538/1081] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:03 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:05.108467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:05.109103 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:05.116242 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:05.116692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:05.117466 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:05.117897 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:05.250198 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:05.258166 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:05.259705 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:05.261156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d81413cf-f1aa-4f1b-a571-64055395e41f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1739 microversion: 2.20 time: 0.156649 Jul 20 23:00:05.261715 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 544/1082] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:05 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:06.279815 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:06.280437 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:06.286866 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:06.287352 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:06.288114 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:06.288585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:06.418982 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:06.427411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:06.428942 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:06.430081 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a222093d-ca50-4295-9bff-b4f84808f8cc tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1721 microversion: 2.20 time: 0.154177 Jul 20 23:00:06.430629 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 539/1083] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:06 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:07.448215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:07.448758 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:07.455326 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:07.455783 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:07.457053 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:07.457525 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:07.587379 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:07.595296 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:07.596794 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:07.598493 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3f5bbe7e-d946-4b51-8ae9-dda0ec7f9c0b tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1721 microversion: 2.20 time: 0.154275 Jul 20 23:00:07.599072 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 545/1084] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:07 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:08.616471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:08.617074 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:08.623597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:08.624050 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:08.624810 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:08.625253 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:08.761993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:08.769966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:08.771578 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:08.772724 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-dc2a2135-681c-483c-8dec-c633d688dcbd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1724 microversion: 2.20 time: 0.160181 Jul 20 23:00:08.773285 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 540/1085] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:08 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 23:00:08.790286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4c0e115e-a4ae-4526-9589-256e52180fa2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30e56dd9-9d2f-4a3c-afca-4a27a900cf39"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:00:08.791403 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4c0e115e-a4ae-4526-9589-256e52180fa2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:08.797784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4c0e115e-a4ae-4526-9589-256e52180fa2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:08.798228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4c0e115e-a4ae-4526-9589-256e52180fa2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:08.798985 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4c0e115e-a4ae-4526-9589-256e52180fa2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:08.799472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4c0e115e-a4ae-4526-9589-256e52180fa2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:09.733341 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4c0e115e-a4ae-4526-9589-256e52180fa2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.947050 Jul 20 23:00:09.733951 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 546/1086] 10.222.0.81 () {62 vars in 1363 bytes} [Wed Jul 20 23:00:08 2022] POST /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/os-volume_attachments => generated 188 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 23:00:09.845216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-77350d06-e45f-402a-affa-4ebc6349e30f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:09.845771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-77350d06-e45f-402a-affa-4ebc6349e30f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:09.853157 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-77350d06-e45f-402a-affa-4ebc6349e30f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:09.853596 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-77350d06-e45f-402a-affa-4ebc6349e30f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:09.854449 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-77350d06-e45f-402a-affa-4ebc6349e30f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:09.854879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-77350d06-e45f-402a-affa-4ebc6349e30f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:09.944615 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-e3e097d3-30c9-4134-95ba-8da64bd99dd7 req-217eb5e9-d6dc-4c96-97a1-32fb269f9790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67b8fa1-b3a3-4778-86bd-b47c4351325e", "name": "network-vif-unplugged", "status": "completed", "tag": "41607f00-87e1-4b7a-ab9d-322990f3e718"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:00:09.954037 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-e3e097d3-30c9-4134-95ba-8da64bd99dd7 req-217eb5e9-d6dc-4c96-97a1-32fb269f9790 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:09.954478 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-e3e097d3-30c9-4134-95ba-8da64bd99dd7 req-217eb5e9-d6dc-4c96-97a1-32fb269f9790 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:09.965271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.compute.server_external_events [req-e3e097d3-30c9-4134-95ba-8da64bd99dd7 req-217eb5e9-d6dc-4c96-97a1-32fb269f9790 service nova] Unable to find a host for instance e67b8fa1-b3a3-4778-86bd-b47c4351325e. Dropping event network-vif-unplugged {{(pid=124913) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 23:00:09.971324 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-e3e097d3-30c9-4134-95ba-8da64bd99dd7 req-217eb5e9-d6dc-4c96-97a1-32fb269f9790 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026356 Jul 20 23:00:09.971324 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 547/1087] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 23:00:10.441784 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-77350d06-e45f-402a-affa-4ebc6349e30f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/os-volume_attachments/30e56dd9-9d2f-4a3c-afca-4a27a900cf39" status: 202 len: 0 microversion: 2.20 time: 0.600456 Jul 20 23:00:10.443018 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 541/1088] 10.222.0.81 () {60 vars in 1456 bytes} [Wed Jul 20 23:00:09 2022] DELETE /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/os-volume_attachments/30e56dd9-9d2f-4a3c-afca-4a27a900cf39 => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 23:00:10.498206 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-aa98cfb3-6710-449e-b77c-cb8c65f02644 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:00:10.498799 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-aa98cfb3-6710-449e-b77c-cb8c65f02644 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:10.505513 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aa98cfb3-6710-449e-b77c-cb8c65f02644 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:10.505961 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aa98cfb3-6710-449e-b77c-cb8c65f02644 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:10.506713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aa98cfb3-6710-449e-b77c-cb8c65f02644 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:10.507176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aa98cfb3-6710-449e-b77c-cb8c65f02644 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:10.712112 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-aa98cfb3-6710-449e-b77c-cb8c65f02644 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "POST /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/action" status: 202 len: 0 microversion: 2.20 time: 0.217685 Jul 20 23:00:10.712642 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 548/1089] 10.222.0.81 () {62 vars in 1318 bytes} [Wed Jul 20 23:00:10 2022] POST /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 23:00:10.720777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:10.721386 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:10.727921 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:10.729808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:10.729808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:10.729808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:10.734425 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:00:10.863891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:10.872021 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:10.873563 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:10.874752 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cb39221a-ae27-47f2-8df7-b6aa95e1b222 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1672 microversion: 2.20 time: 0.157980 Jul 20 23:00:10.875338 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 542/1090] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:10 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:11.893451 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:11.894993 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:11.902483 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:11.902929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:11.903729 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:11.904163 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:12.040364 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:12.048636 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:12.051653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:12.051653 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cc4d8db4-68b2-45c4-9814-36d3c334d92c tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1674 microversion: 2.20 time: 0.161935 Jul 20 23:00:12.052194 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 549/1091] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:11 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:13.070467 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:13.071136 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:13.078000 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:13.078449 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:13.079518 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:13.079956 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:13.214792 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:13.222951 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:13.224480 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:13.225639 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e7dee2c7-468e-4d9a-a3ae-f88d5df69a10 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.160035 Jul 20 23:00:13.226193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 543/1092] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:13 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:14.244903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:14.246980 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:14.255145 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:14.255597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:14.256486 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:14.256948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:14.259996 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:00:14.401236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:14.410911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:14.412487 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:14.413658 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f01eefd8-d322-4385-8ba2-7d2848134845 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.173750 Jul 20 23:00:14.425535 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 550/1093] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:14 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:15.431092 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:15.431712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:15.451951 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:15.452288 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:15.453294 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:15.453923 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:15.597493 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:15.606065 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:15.610216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:15.610216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-445baed3-f28d-425a-bd26-6a5f158595b9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.181621 Jul 20 23:00:15.610216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 544/1094] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:15 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:16.628512 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:16.630348 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:16.639078 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:16.639693 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:16.640485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:16.640951 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:16.776713 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:16.785045 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:16.786560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:16.787769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-14906b57-677c-47f3-9148-ee837d1ecc43 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.164575 Jul 20 23:00:16.795189 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 551/1095] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:16 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:17.805955 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:17.806706 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:17.813159 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:17.813620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:17.814367 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:17.814804 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:17.956865 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:17.966620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:17.969389 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:17.970591 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7e7190e8-a60f-4662-924e-be7626b58f83 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.168742 Jul 20 23:00:17.982561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 545/1096] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:17 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:18.991584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:18.992235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:18.994711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=34 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:00:18.999557 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:19.000005 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:19.000776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:19.001206 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:19.140476 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:19.151162 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:19.153117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:19.154612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f45ce30a-9af7-4fdf-a956-fecf91958719 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.169138 Jul 20 23:00:19.155428 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 552/1097] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:18 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:20.175550 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:20.175550 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:20.187554 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:20.188006 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:20.188781 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:20.189214 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:20.334975 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:20.343258 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:20.357251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:20.357251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7962d24d-c493-45ca-aac9-8109ff75dac3 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.175753 Jul 20 23:00:20.357251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 546/1098] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:20 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:21.372660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:21.372660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:21.372660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:21.372660 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:21.373559 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:21.373769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:21.508148 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:21.516274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:21.517767 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:21.519454 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3a006272-7671-41db-bc27-d3d3cfd4da6e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.158462 Jul 20 23:00:21.520014 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 553/1099] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:21 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:22.537513 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:22.538080 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:22.540317 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=30 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:00:22.545638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:22.546188 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:22.547175 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:22.547740 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:22.683110 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:22.690955 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:22.692475 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:22.693619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-bb909385-ef9d-4266-9880-e64ed6fae635 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.160154 Jul 20 23:00:22.694172 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 547/1100] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:22 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:23.711226 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:23.711818 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:23.718298 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:23.718737 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:23.719515 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:23.719943 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:23.854905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:23.863498 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:23.864995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:23.866152 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fe34ea0d-4370-4bd3-b060-694ad2d73cc0 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.158931 Jul 20 23:00:23.866716 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 554/1101] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:23 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:24.883943 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:24.884579 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:24.891393 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:24.891840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:24.892598 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:24.893042 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:25.020667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:25.028629 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:25.030137 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:25.031380 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-baca3ed4-face-4f27-9e35-47044bdd62be tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.151234 Jul 20 23:00:25.031941 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 548/1102] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:24 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:26.049571 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:26.050683 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:26.057154 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:26.057598 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:26.058354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:26.058789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:26.343916 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:26.352424 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:26.353917 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:26.355081 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1f44059b-3003-4699-ab57-127d5c630251 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.309397 Jul 20 23:00:26.355634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 555/1103] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:26 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:27.373228 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:27.373827 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:27.380446 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:27.380886 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:27.381634 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:27.382061 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:27.565778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:27.573672 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:27.575186 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:27.576382 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d4146ef1-e824-4f87-bf9c-f4b311a37f1f tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.207120 Jul 20 23:00:27.576940 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 549/1104] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:27 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:28.595920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:28.597079 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:28.603527 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:28.603992 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:28.604755 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:28.605191 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:28.732822 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:28.741323 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:28.742819 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:28.744002 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-be3f428c-2778-4442-8793-cad4af9fcdc9 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.151994 Jul 20 23:00:28.744564 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 556/1105] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:28 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:29.762887 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:29.763543 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:29.770045 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:29.770487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:29.771275 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:29.771721 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:29.899444 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:29.909528 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:29.911144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:29.912315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2f077bbf-ba17-4308-9045-91d7643f3cc1 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.153636 Jul 20 23:00:29.913088 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 550/1106] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:29 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:29.990485 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-213cbdce-96ad-4545-9afc-c7bb1fb72ab4 req-024e3e06-7459-495a-a463-bb19fcac3adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67b8fa1-b3a3-4778-86bd-b47c4351325e", "name": "network-vif-plugged", "status": "completed", "tag": "41607f00-87e1-4b7a-ab9d-322990f3e718"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:00:30.006130 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-213cbdce-96ad-4545-9afc-c7bb1fb72ab4 req-024e3e06-7459-495a-a463-bb19fcac3adb service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:30.006636 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-213cbdce-96ad-4545-9afc-c7bb1fb72ab4 req-024e3e06-7459-495a-a463-bb19fcac3adb service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:30.018174 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-213cbdce-96ad-4545-9afc-c7bb1fb72ab4 req-024e3e06-7459-495a-a463-bb19fcac3adb service nova] Creating event network-vif-plugged:41607f00-87e1-4b7a-ab9d-322990f3e718 for instance e67b8fa1-b3a3-4778-86bd-b47c4351325e on hv-cinder-79987 Jul 20 23:00:30.024026 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-213cbdce-96ad-4545-9afc-c7bb1fb72ab4 req-024e3e06-7459-495a-a463-bb19fcac3adb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 Jul 20 23:00:30.027909 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 557/1107] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:00:30.929555 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:30.930184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:30.936817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:30.937259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:30.938001 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:30.938428 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:31.063402 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:31.071846 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:31.073333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:31.074493 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-7bf9175b-4b0a-4abe-a9c5-6b445d9a7981 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.148892 Jul 20 23:00:31.075056 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 551/1108] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:30 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:32.094661 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:32.095369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:32.102171 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:32.102610 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:32.103390 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:32.103817 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:32.237948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:32.245927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:32.247429 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:32.248563 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c493d188-1b3b-4d66-bc4b-d181a9a49c75 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.158783 Jul 20 23:00:32.249120 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 558/1109] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:32 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:33.267018 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:33.267646 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:33.274361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:33.274801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:33.275636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:33.276066 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:33.419226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:33.422276 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:33.423810 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:33.424958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-996da1f8-2d52-4b59-a6df-67f331c527b6 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1730 microversion: 2.20 time: 0.162210 Jul 20 23:00:33.425518 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 552/1110] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:33 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:34.443562 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:00:34.444169 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:00:34.451170 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:34.451626 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:34.452391 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:00:34.452828 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:00:34.580706 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:34.588597 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:34.590090 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:00:34.591274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-61b28980-fd07-47b3-83d7-d27ba49b43f2 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1717 microversion: 2.20 time: 0.152258 Jul 20 23:00:34.591829 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 559/1111] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:00:34 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:00:34.799367 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:00:34.799605 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:00:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:00:45.540220 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:00:45.540701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:00:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:01:30.054789 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8c0e2e86-bb50-4052-b34f-e6b85264071e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:30.055859 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8c0e2e86-bb50-4052-b34f-e6b85264071e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:30.058019 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=11 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:01:30.058659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=65 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:01:30.063582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8c0e2e86-bb50-4052-b34f-e6b85264071e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:30.064677 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8c0e2e86-bb50-4052-b34f-e6b85264071e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:30.065433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8c0e2e86-bb50-4052-b34f-e6b85264071e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:30.065860 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8c0e2e86-bb50-4052-b34f-e6b85264071e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:30.097276 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8c0e2e86-bb50-4052-b34f-e6b85264071e tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046481 Jul 20 23:01:30.097861 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 553/1112] 10.222.0.81 () {60 vars in 1342 bytes} [Wed Jul 20 23:01:30 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:01:30.156381 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b4cafeb9-f983-43a6-a230-0d55a0bf046d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:30.156920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b4cafeb9-f983-43a6-a230-0d55a0bf046d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:30.159211 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=15 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:01:30.159864 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=55 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:01:30.164625 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b4cafeb9-f983-43a6-a230-0d55a0bf046d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:30.165074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b4cafeb9-f983-43a6-a230-0d55a0bf046d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:30.165837 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b4cafeb9-f983-43a6-a230-0d55a0bf046d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:30.166299 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-b4cafeb9-f983-43a6-a230-0d55a0bf046d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:30.192000 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-b4cafeb9-f983-43a6-a230-0d55a0bf046d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 23:01:30.504070 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b4cafeb9-f983-43a6-a230-0d55a0bf046d tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 204 len: 0 microversion: 2.20 time: 0.351751 Jul 20 23:01:30.504574 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 560/1113] 10.222.0.81 () {60 vars in 1279 bytes} [Wed Jul 20 23:01:30 2022] DELETE /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 23:01:30.513074 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:30.515644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:30.521058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:30.521507 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:30.522264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:30.522705 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:30.650250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:30.663457 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:30.670226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:30.670226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d76913e8-3bd5-478a-a69c-4e248d45c028 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.157270 Jul 20 23:01:30.670226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 554/1114] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:01:30 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 23:01:31.684815 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:31.685520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:31.692937 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:31.693551 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:31.694345 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:31.694782 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:31.825723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:31.834166 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:31.835731 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:31.836894 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-480b9908-ae21-4fec-bdfd-fbdd41856f05 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1723 microversion: 2.20 time: 0.156365 Jul 20 23:01:31.837449 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 561/1115] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:01:31 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:01:32.855403 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:32.856016 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:32.862862 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:32.866216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:32.866216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:32.866216 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:32.931645 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:32.941386 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:32.942991 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:32.944227 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-de5ffcbd-03ee-4d41-b17f-44842c8ddf01 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1655 microversion: 2.20 time: 0.092957 Jul 20 23:01:32.944778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 555/1116] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:01:32 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:01:33.219965 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-99a596d7-dffd-41cc-a734-457f49e4f3be req-c51431f8-90a3-47f0-9078-822a7c79d94d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67b8fa1-b3a3-4778-86bd-b47c4351325e", "name": "network-vif-deleted", "tag": "41607f00-87e1-4b7a-ab9d-322990f3e718"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:01:33.230197 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-99a596d7-dffd-41cc-a734-457f49e4f3be req-c51431f8-90a3-47f0-9078-822a7c79d94d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:33.231064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-99a596d7-dffd-41cc-a734-457f49e4f3be req-c51431f8-90a3-47f0-9078-822a7c79d94d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:33.242717 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-99a596d7-dffd-41cc-a734-457f49e4f3be req-c51431f8-90a3-47f0-9078-822a7c79d94d service nova] Creating event network-vif-deleted:41607f00-87e1-4b7a-ab9d-322990f3e718 for instance e67b8fa1-b3a3-4778-86bd-b47c4351325e on hv-cinder-79987 Jul 20 23:01:33.247878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-99a596d7-dffd-41cc-a734-457f49e4f3be req-c51431f8-90a3-47f0-9078-822a7c79d94d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031839 Jul 20 23:01:33.248470 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 562/1117] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:01:33.961998 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:33.962650 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:33.969825 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:33.970459 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:33.972914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:33.973748 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:34.009268 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:34.009736 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:34.010298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lazy-loading 'fault' on Instance uuid e67b8fa1-b3a3-4778-86bd-b47c4351325e {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 23:01:34.057063 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:34.066119 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:34.067682 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc19753d420840ffa5cde19d4c1fac8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ace18b7cfda4329adb560220ff909cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:01:34.068872 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c53969c9-40ad-483e-a21c-133c3f7c14a5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 200 len: 1371 microversion: 2.20 time: 0.110898 Jul 20 23:01:34.069734 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 556/1118] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:01:33 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 23:01:35.088460 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:35.089208 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:35.095995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:35.096447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:35.097231 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:35.097650 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:35.111319 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] HTTP exception thrown: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Request method failure captured: Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e HTTP/1.1 Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IdiySP8hM8EtIpOyagRdXbvkGpasHBuuCqPeLLHNN4L0PGOPNBpzA_KbJ94QHChkKS6FIPkj-qfy5--xSRCVNDkLrw6KxJ3-dTK3-SsmCKzXoONJ_5BiiCpyUVhLfEWpEeBVWJgIxaD1rLSXirbre75JzXnZZ_njIGOsh3Au0YLkbI Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 23:01:35.112929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ace18b7cfda4329adb560220ff909cc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: bc19753d420840ffa5cde19d4c1fac8f Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:35.114687 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'e67b8fa1-b3a3-4778-86bd-b47c4351325e'} Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:01:35.115778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:35.117336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:35.118793 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Returning 404 to user: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:01:35.118793 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-468de35c-accf-43a1-b676-9e6f5611bac5 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 404 len: 111 microversion: 2.20 time: 0.030154 Jul 20 23:01:35.118793 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 563/1119] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:01:35 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 23:01:35.123003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1bb1b985-c1ea-43a0-9fa4-e49e3e1c2ace tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '.version_select at 0x7fe243ecf4c0>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:35.213894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1bb1b985-c1ea-43a0-9fa4-e49e3e1c2ace tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682444703" status: 204 len: 0 microversion: 2.20 time: 0.094591 Jul 20 23:01:35.217716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 557/1120] 10.222.0.81 () {60 vars in 1261 bytes} [Wed Jul 20 23:01:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682444703 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 23:01:37.299847 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:37.300345 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:37.306715 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:37.307183 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:37.307948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:37.308384 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:37.322216 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] HTTP exception thrown: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Request method failure captured: Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e HTTP/1.1 Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IdiySP8hM8EtIpOyagRdXbvkGpasHBuuCqPeLLHNN4L0PGOPNBpzA_KbJ94QHChkKS6FIPkj-qfy5--xSRCVNDkLrw6KxJ3-dTK3-SsmCKzXoONJ_5BiiCpyUVhLfEWpEeBVWJgIxaD1rLSXirbre75JzXnZZ_njIGOsh3Au0YLkbI Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 23:01:37.323784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ace18b7cfda4329adb560220ff909cc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: bc19753d420840ffa5cde19d4c1fac8f Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.325465 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'e67b8fa1-b3a3-4778-86bd-b47c4351325e'} Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:01:37.327185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.328672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.330158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Returning 404 to user: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:01:37.330158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ac1b218a-b1a6-4dd3-9568-cfe04768f3fb tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 404 len: 111 microversion: 2.20 time: 0.029798 Jul 20 23:01:37.330158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 564/1121] 10.222.0.81 () {60 vars in 1279 bytes} [Wed Jul 20 23:01:37 2022] DELETE /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 23:01:37.333637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:37.334298 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: e67b8fa1-b3a3-4778-86bd-b47c4351325e] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:37.341509 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:37.341952 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:37.342697 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:37.343154 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:37.355949 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] HTTP exception thrown: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Request method failure captured: Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e HTTP/1.1 Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IdiySP8hM8EtIpOyagRdXbvkGpasHBuuCqPeLLHNN4L0PGOPNBpzA_KbJ94QHChkKS6FIPkj-qfy5--xSRCVNDkLrw6KxJ3-dTK3-SsmCKzXoONJ_5BiiCpyUVhLfEWpEeBVWJgIxaD1rLSXirbre75JzXnZZ_njIGOsh3Au0YLkbI Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 23:01:37.357460 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ace18b7cfda4329adb560220ff909cc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: bc19753d420840ffa5cde19d4c1fac8f Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.359265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'e67b8fa1-b3a3-4778-86bd-b47c4351325e'} Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:01:37.360250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. Jul 20 23:01:37.362248 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:37.363752 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Returning 404 to user: Instance e67b8fa1-b3a3-4778-86bd-b47c4351325e could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:01:37.363752 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e055eaa3-5df4-4b12-8c97-8d388374bdf7 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e" status: 404 len: 111 microversion: 2.20 time: 0.028965 Jul 20 23:01:37.363752 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 558/1122] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:01:37 2022] GET /compute/v2.1/servers/e67b8fa1-b3a3-4778-86bd-b47c4351325e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 23:01:38.610944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:38.611454 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:38.617940 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:38.618378 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:38.619156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:38.619586 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:38.633262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] HTTP exception thrown: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Request method failure captured: Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 HTTP/1.1 Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IdiySP8hM8EtIpOyagRdXbvkGpasHBuuCqPeLLHNN4L0PGOPNBpzA_KbJ94QHChkKS6FIPkj-qfy5--xSRCVNDkLrw6KxJ3-dTK3-SsmCKzXoONJ_5BiiCpyUVhLfEWpEeBVWJgIxaD1rLSXirbre75JzXnZZ_njIGOsh3Au0YLkbI Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 23:01:38.635056 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ace18b7cfda4329adb560220ff909cc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: bc19753d420840ffa5cde19d4c1fac8f Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.636732 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '0dca5cf4-1a98-44f6-bcfe-dba13d327330'} Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:01:38.637641 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.639134 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.640548 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Returning 404 to user: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:01:38.640548 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-52f44e64-073e-4ab5-a36c-285a0c28cabd tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "DELETE /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 404 len: 111 microversion: 2.20 time: 0.029283 Jul 20 23:01:38.640548 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 565/1123] 10.222.0.81 () {60 vars in 1279 bytes} [Wed Jul 20 23:01:38 2022] DELETE /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 23:01:38.645397 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:01:38.646009 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] [instance: 0dca5cf4-1a98-44f6-bcfe-dba13d327330] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:01:38.652441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:38.652889 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:38.653647 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:01:38.654093 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:01:38.667214 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] HTTP exception thrown: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Request method failure captured: Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 HTTP/1.1 Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IdiySP8hM8EtIpOyagRdXbvkGpasHBuuCqPeLLHNN4L0PGOPNBpzA_KbJ94QHChkKS6FIPkj-qfy5--xSRCVNDkLrw6KxJ3-dTK3-SsmCKzXoONJ_5BiiCpyUVhLfEWpEeBVWJgIxaD1rLSXirbre75JzXnZZ_njIGOsh3Au0YLkbI Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 23:01:38.668727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_7ace18b7cfda4329adb560220ff909cc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/7ace18b7cfda4329adb560220ff909cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 7ace18b7cfda4329adb560220ff909cc Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-162581451 Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: bc19753d420840ffa5cde19d4c1fac8f Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-AttachVolumeShelveTestJSON-162581451-project Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.670395 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': '0dca5cf4-1a98-44f6-bcfe-dba13d327330'} Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:01:38.671178 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. Jul 20 23:01:38.672472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:01:38.673566 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] Returning 404 to user: Instance 0dca5cf4-1a98-44f6-bcfe-dba13d327330 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:01:38.673566 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b60e0373-ed8c-43ec-9ff0-29e0bd9b1802 tempest-AttachVolumeShelveTestJSON-162581451 tempest-AttachVolumeShelveTestJSON-162581451-project] 10.222.0.81 "GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330" status: 404 len: 111 microversion: 2.20 time: 0.029222 Jul 20 23:01:38.673566 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 559/1124] 10.222.0.81 () {60 vars in 1276 bytes} [Wed Jul 20 23:01:38 2022] GET /compute/v2.1/servers/0dca5cf4-1a98-44f6-bcfe-dba13d327330 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 23:02:38.251555 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-b540165b-eec3-4f8f-91f6-3d4556a20707 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Action: 'create', calling method: .version_select at 0x7fe243ff59d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1824065508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVnzs6WmQk0mmhgF/ubeLf3wytf6VsR5IsFUJisK6mW21aMADNq8IO4samZJSUTaVWOfKUSMKrttSOhoZJVhSxBdWMBsvO2htWsJzp5GFTKBJtlpkAGIkRHAhr9lobxiw=="}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:02:38.255861 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:02:38.256536 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:02:38.267725 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-b540165b-eec3-4f8f-91f6-3d4556a20707 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Getting quotas for project 62f889bb65b048cb96e5548e4420df8f. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 23:02:38.271556 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-b540165b-eec3-4f8f-91f6-3d4556a20707 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Getting quotas for user 07feb13dc066470cae9d68d0d38d89cb and project 62f889bb65b048cb96e5548e4420df8f. Resources: {'key_pairs'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 23:02:38.441801 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-b540165b-eec3-4f8f-91f6-3d4556a20707 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.194028 Jul 20 23:02:38.442402 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 566/1125] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 23:02:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:02:38.490612 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1580105594", "imageRef": "448d0d09-7ed6-4c70-b8ff-6f7cd49efea2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1824065508", "networks": [{"uuid": "fcbf324b-1b34-4fc8-a501-ba363958eb83"}]}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:02:38.498520 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:02:38.499208 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=30 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:02:38.543725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] validate_networks() for [('fcbf324b-1b34-4fc8-a501-ba363958eb83', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 23:02:38.914516 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 23:02:38.914931 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 23:02:38.915430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 23:02:38.915834 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 23:02:38.916235 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 23:02:38.925413 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:38.925848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:38.926622 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:38.927070 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:38.943838 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Getting quotas for project 62f889bb65b048cb96e5548e4420df8f. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 23:02:38.947671 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Getting quotas for user 07feb13dc066470cae9d68d0d38d89cb and project 62f889bb65b048cb96e5548e4420df8f. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 23:02:38.958281 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 23:02:38.960423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='448d0d09-7ed6-4c70-b8ff-6f7cd49efea2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 23:02:39.138915 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d8026818-648f-4ed3-8d79-601c8b02c2cc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652308 Jul 20 23:02:39.139602 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 560/1126] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 23:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 23:02:39.150383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-660ea2a1-ace6-401c-a896-a8a2c96305a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:39.150994 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-660ea2a1-ace6-401c-a896-a8a2c96305a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:39.207220 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-660ea2a1-ace6-401c-a896-a8a2c96305a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:39.214592 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-660ea2a1-ace6-401c-a896-a8a2c96305a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1259 microversion: 2.1 time: 0.068774 Jul 20 23:02:39.215288 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 567/1127] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:39 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:40.232585 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6d417d07-b2ce-4574-a92f-314e6435f3cd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:40.233196 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6d417d07-b2ce-4574-a92f-314e6435f3cd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:40.288798 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6d417d07-b2ce-4574-a92f-314e6435f3cd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:40.295421 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6d417d07-b2ce-4574-a92f-314e6435f3cd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1259 microversion: 2.1 time: 0.067281 Jul 20 23:02:40.296452 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 561/1128] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:40 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:41.312508 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-03adb596-f325-438b-a1d6-703764d920f7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:41.313693 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-03adb596-f325-438b-a1d6-703764d920f7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:41.319736 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-03adb596-f325-438b-a1d6-703764d920f7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:41.320176 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-03adb596-f325-438b-a1d6-703764d920f7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:41.320927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-03adb596-f325-438b-a1d6-703764d920f7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:41.321354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-03adb596-f325-438b-a1d6-703764d920f7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:41.385647 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-03adb596-f325-438b-a1d6-703764d920f7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:41.393097 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-03adb596-f325-438b-a1d6-703764d920f7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1311 microversion: 2.1 time: 0.084698 Jul 20 23:02:41.393646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 568/1129] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:41 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:42.415930 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cfda058a-7604-436e-8e27-64ce432d8376 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:42.416548 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cfda058a-7604-436e-8e27-64ce432d8376 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:42.424361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cfda058a-7604-436e-8e27-64ce432d8376 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:42.424808 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cfda058a-7604-436e-8e27-64ce432d8376 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:42.425621 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cfda058a-7604-436e-8e27-64ce432d8376 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:42.426059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cfda058a-7604-436e-8e27-64ce432d8376 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:42.491835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cfda058a-7604-436e-8e27-64ce432d8376 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:42.499210 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cfda058a-7604-436e-8e27-64ce432d8376 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1317 microversion: 2.1 time: 0.088469 Jul 20 23:02:42.500540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 562/1130] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:42 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1317 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:43.518436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4cdc2db5-6cc9-4eee-b947-13e9f1ea751f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:43.519855 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4cdc2db5-6cc9-4eee-b947-13e9f1ea751f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:43.527255 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4cdc2db5-6cc9-4eee-b947-13e9f1ea751f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:43.527987 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4cdc2db5-6cc9-4eee-b947-13e9f1ea751f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:43.528944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4cdc2db5-6cc9-4eee-b947-13e9f1ea751f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:43.529380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4cdc2db5-6cc9-4eee-b947-13e9f1ea751f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:43.745635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-4cdc2db5-6cc9-4eee-b947-13e9f1ea751f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:43.753721 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4cdc2db5-6cc9-4eee-b947-13e9f1ea751f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.240178 Jul 20 23:02:43.754435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 569/1131] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:43 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:44.008438 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-c5146540-7df8-44f3-a53f-0156c59146f9 req-b28e39dc-6423-4811-8c66-0e9775f99889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9b4a32-fe13-47b5-89cd-6daf89b808ab", "tag": "c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:02:44.018321 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c5146540-7df8-44f3-a53f-0156c59146f9 req-b28e39dc-6423-4811-8c66-0e9775f99889 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:44.018983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c5146540-7df8-44f3-a53f-0156c59146f9 req-b28e39dc-6423-4811-8c66-0e9775f99889 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:44.034879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-c5146540-7df8-44f3-a53f-0156c59146f9 req-b28e39dc-6423-4811-8c66-0e9775f99889 service nova] Creating event network-changed:c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab for instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab on hv-cinder-79987 Jul 20 23:02:44.039235 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR oslo.messaging._drivers.impl_rabbit [req-c5146540-7df8-44f3-a53f-0156c59146f9 req-b28e39dc-6423-4811-8c66-0e9775f99889 service nova] [6756b560-4c70-4efe-97a1-6753c064898d] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 23:02:44.772026 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-802969e4-8d4b-4922-b843-f2d7a6c28a83 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:44.772639 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-802969e4-8d4b-4922-b843-f2d7a6c28a83 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:44.779440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-802969e4-8d4b-4922-b843-f2d7a6c28a83 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:44.780230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-802969e4-8d4b-4922-b843-f2d7a6c28a83 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:44.782317 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-802969e4-8d4b-4922-b843-f2d7a6c28a83 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:44.782995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-802969e4-8d4b-4922-b843-f2d7a6c28a83 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:44.929395 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-802969e4-8d4b-4922-b843-f2d7a6c28a83 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:44.937252 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-802969e4-8d4b-4922-b843-f2d7a6c28a83 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.169528 Jul 20 23:02:44.938138 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 570/1132] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:44 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 23:02:45.048717 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [req-c5146540-7df8-44f3-a53f-0156c59146f9 req-b28e39dc-6423-4811-8c66-0e9775f99889 service nova] [6756b560-4c70-4efe-97a1-6753c064898d] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 47974. Jul 20 23:02:45.052117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-c5146540-7df8-44f3-a53f-0156c59146f9 req-b28e39dc-6423-4811-8c66-0e9775f99889 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.228700 Jul 20 23:02:45.052719 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 563/1133] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:02:45.954928 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cf3e4ba6-3545-41eb-aa7b-7687be002ac9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:45.955750 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cf3e4ba6-3545-41eb-aa7b-7687be002ac9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:45.963038 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cf3e4ba6-3545-41eb-aa7b-7687be002ac9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:45.963849 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cf3e4ba6-3545-41eb-aa7b-7687be002ac9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:45.964908 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cf3e4ba6-3545-41eb-aa7b-7687be002ac9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:45.965563 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cf3e4ba6-3545-41eb-aa7b-7687be002ac9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:46.103327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cf3e4ba6-3545-41eb-aa7b-7687be002ac9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:46.111210 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cf3e4ba6-3545-41eb-aa7b-7687be002ac9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.161320 Jul 20 23:02:46.111794 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 571/1134] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:45 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 23:02:47.131529 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-82b39770-0b18-451b-a243-cadda5868566 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:47.133507 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-82b39770-0b18-451b-a243-cadda5868566 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:47.142344 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82b39770-0b18-451b-a243-cadda5868566 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:47.143221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82b39770-0b18-451b-a243-cadda5868566 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:47.144429 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82b39770-0b18-451b-a243-cadda5868566 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:47.145284 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-82b39770-0b18-451b-a243-cadda5868566 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:47.304905 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-82b39770-0b18-451b-a243-cadda5868566 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:47.312516 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-82b39770-0b18-451b-a243-cadda5868566 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.187435 Jul 20 23:02:47.313712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 564/1135] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:47 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:48.330354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ee222ab3-a605-42b5-9526-84652a24b2c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:48.331082 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ee222ab3-a605-42b5-9526-84652a24b2c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:48.338126 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ee222ab3-a605-42b5-9526-84652a24b2c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:48.338592 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ee222ab3-a605-42b5-9526-84652a24b2c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:48.339425 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ee222ab3-a605-42b5-9526-84652a24b2c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:48.339889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ee222ab3-a605-42b5-9526-84652a24b2c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:48.481793 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ee222ab3-a605-42b5-9526-84652a24b2c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:48.491594 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ee222ab3-a605-42b5-9526-84652a24b2c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.165618 Jul 20 23:02:48.492185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 572/1136] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:48 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:49.510619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ae987246-2822-4bda-8302-6c5ac8c1a2e0 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:49.511323 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ae987246-2822-4bda-8302-6c5ac8c1a2e0 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:49.517845 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:02:49.524619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae987246-2822-4bda-8302-6c5ac8c1a2e0 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:49.525073 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae987246-2822-4bda-8302-6c5ac8c1a2e0 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:49.525874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae987246-2822-4bda-8302-6c5ac8c1a2e0 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:49.526314 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ae987246-2822-4bda-8302-6c5ac8c1a2e0 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:49.663226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ae987246-2822-4bda-8302-6c5ac8c1a2e0 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:49.670772 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ae987246-2822-4bda-8302-6c5ac8c1a2e0 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.164557 Jul 20 23:02:49.675821 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 565/1137] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:49 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:50.687487 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8b5201e6-1ba1-4661-b626-e74458bb4d08 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:50.688603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8b5201e6-1ba1-4661-b626-e74458bb4d08 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:50.690397 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=6 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:02:50.695681 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8b5201e6-1ba1-4661-b626-e74458bb4d08 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:50.696195 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8b5201e6-1ba1-4661-b626-e74458bb4d08 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:50.696889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8b5201e6-1ba1-4661-b626-e74458bb4d08 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:50.697325 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8b5201e6-1ba1-4661-b626-e74458bb4d08 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:50.824136 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8b5201e6-1ba1-4661-b626-e74458bb4d08 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:50.831541 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8b5201e6-1ba1-4661-b626-e74458bb4d08 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.147843 Jul 20 23:02:50.832131 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 573/1138] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:50 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:51.849451 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-66ac6600-4e8a-4919-8a94-c52f6f1c6f55 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:51.850057 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-66ac6600-4e8a-4919-8a94-c52f6f1c6f55 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:51.852236 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=8 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:02:51.857517 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-66ac6600-4e8a-4919-8a94-c52f6f1c6f55 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:51.857959 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-66ac6600-4e8a-4919-8a94-c52f6f1c6f55 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:51.858708 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-66ac6600-4e8a-4919-8a94-c52f6f1c6f55 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:51.859170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-66ac6600-4e8a-4919-8a94-c52f6f1c6f55 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:51.990356 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-66ac6600-4e8a-4919-8a94-c52f6f1c6f55 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:51.996616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-66ac6600-4e8a-4919-8a94-c52f6f1c6f55 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.150980 Jul 20 23:02:51.997185 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 566/1139] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:51 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:53.013728 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d9d1e5ec-74f6-4d43-8b51-6a8ba868fbcc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:53.078730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d9d1e5ec-74f6-4d43-8b51-6a8ba868fbcc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:53.078730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9d1e5ec-74f6-4d43-8b51-6a8ba868fbcc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:53.078730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9d1e5ec-74f6-4d43-8b51-6a8ba868fbcc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:53.078730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9d1e5ec-74f6-4d43-8b51-6a8ba868fbcc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:53.079225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9d1e5ec-74f6-4d43-8b51-6a8ba868fbcc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:53.158165 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d9d1e5ec-74f6-4d43-8b51-6a8ba868fbcc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:53.165723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d9d1e5ec-74f6-4d43-8b51-6a8ba868fbcc tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.155889 Jul 20 23:02:53.166284 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 574/1140] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:53 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:54.181786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-65c58653-ed95-4a95-ab81-1aaecfaacc82 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:54.182535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-65c58653-ed95-4a95-ab81-1aaecfaacc82 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:54.189160 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-65c58653-ed95-4a95-ab81-1aaecfaacc82 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:54.189600 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-65c58653-ed95-4a95-ab81-1aaecfaacc82 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:54.190412 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-65c58653-ed95-4a95-ab81-1aaecfaacc82 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:54.190945 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-65c58653-ed95-4a95-ab81-1aaecfaacc82 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:54.329424 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-65c58653-ed95-4a95-ab81-1aaecfaacc82 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:54.336876 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-65c58653-ed95-4a95-ab81-1aaecfaacc82 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.159128 Jul 20 23:02:54.337434 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 567/1141] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:54 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:55.354115 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-834fe744-7602-414e-a0ff-8ccb8007f628 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:55.354723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-834fe744-7602-414e-a0ff-8ccb8007f628 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:55.361789 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-834fe744-7602-414e-a0ff-8ccb8007f628 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:55.362234 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-834fe744-7602-414e-a0ff-8ccb8007f628 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:55.362991 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-834fe744-7602-414e-a0ff-8ccb8007f628 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:55.363458 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-834fe744-7602-414e-a0ff-8ccb8007f628 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:55.493433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-834fe744-7602-414e-a0ff-8ccb8007f628 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:55.501526 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-834fe744-7602-414e-a0ff-8ccb8007f628 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.151282 Jul 20 23:02:55.502083 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 575/1142] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:55 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:56.518361 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c17ebd26-f123-4c60-be2d-2be4c0501090 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:56.519027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c17ebd26-f123-4c60-be2d-2be4c0501090 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:56.525523 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c17ebd26-f123-4c60-be2d-2be4c0501090 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:56.525973 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c17ebd26-f123-4c60-be2d-2be4c0501090 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:56.526730 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c17ebd26-f123-4c60-be2d-2be4c0501090 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:56.527213 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c17ebd26-f123-4c60-be2d-2be4c0501090 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:56.655754 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c17ebd26-f123-4c60-be2d-2be4c0501090 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:56.663814 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c17ebd26-f123-4c60-be2d-2be4c0501090 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.149281 Jul 20 23:02:56.664374 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 568/1143] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:56 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:57.680978 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d9804721-1d38-4194-baf6-6f73ae129740 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:57.681592 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d9804721-1d38-4194-baf6-6f73ae129740 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:57.688656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9804721-1d38-4194-baf6-6f73ae129740 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:57.689095 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9804721-1d38-4194-baf6-6f73ae129740 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:57.689841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9804721-1d38-4194-baf6-6f73ae129740 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:57.690267 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d9804721-1d38-4194-baf6-6f73ae129740 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:57.815945 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d9804721-1d38-4194-baf6-6f73ae129740 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:57.823243 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d9804721-1d38-4194-baf6-6f73ae129740 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.146053 Jul 20 23:02:57.823804 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 576/1144] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:57 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:02:58.839989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-031a8171-c38a-4f00-80da-c29b27187cde tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:02:58.840597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-031a8171-c38a-4f00-80da-c29b27187cde tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:02:58.847621 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-031a8171-c38a-4f00-80da-c29b27187cde tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:58.848065 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-031a8171-c38a-4f00-80da-c29b27187cde tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:58.848815 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-031a8171-c38a-4f00-80da-c29b27187cde tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:02:58.849250 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-031a8171-c38a-4f00-80da-c29b27187cde tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:02:58.978745 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-031a8171-c38a-4f00-80da-c29b27187cde tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:02:58.986420 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-031a8171-c38a-4f00-80da-c29b27187cde tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.150287 Jul 20 23:02:58.986980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 569/1145] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:58 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:03:00.003725 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e9b26de7-d1dc-4632-93c5-e6aa621f541c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:00.004335 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e9b26de7-d1dc-4632-93c5-e6aa621f541c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:00.011135 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9b26de7-d1dc-4632-93c5-e6aa621f541c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:00.011582 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9b26de7-d1dc-4632-93c5-e6aa621f541c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:00.012344 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9b26de7-d1dc-4632-93c5-e6aa621f541c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:00.012785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e9b26de7-d1dc-4632-93c5-e6aa621f541c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:00.141521 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e9b26de7-d1dc-4632-93c5-e6aa621f541c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:00.148955 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e9b26de7-d1dc-4632-93c5-e6aa621f541c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.149644 Jul 20 23:03:00.149517 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 577/1146] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:02:59 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:03:00.737637 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-b90bad03-dd2c-4937-8ed2-421e08ae8ede req-77a03db1-ddb3-4521-ad9c-ea9599f9bee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9b4a32-fe13-47b5-89cd-6daf89b808ab", "name": "network-vif-plugged", "status": "completed", "tag": "c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:03:00.746359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-b90bad03-dd2c-4937-8ed2-421e08ae8ede req-77a03db1-ddb3-4521-ad9c-ea9599f9bee4 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:00.746797 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-b90bad03-dd2c-4937-8ed2-421e08ae8ede req-77a03db1-ddb3-4521-ad9c-ea9599f9bee4 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:00.760184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-b90bad03-dd2c-4937-8ed2-421e08ae8ede req-77a03db1-ddb3-4521-ad9c-ea9599f9bee4 service nova] Creating event network-vif-plugged:c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab for instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab on hv-cinder-79987 Jul 20 23:03:00.765184 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-b90bad03-dd2c-4937-8ed2-421e08ae8ede req-77a03db1-ddb3-4521-ad9c-ea9599f9bee4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Jul 20 23:03:00.766271 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 570/1147] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:03:01.165633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-78a67a45-5918-49aa-b357-72d8ba523c4f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:01.166265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-78a67a45-5918-49aa-b357-72d8ba523c4f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:01.172798 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-78a67a45-5918-49aa-b357-72d8ba523c4f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:01.173237 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-78a67a45-5918-49aa-b357-72d8ba523c4f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:01.173984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-78a67a45-5918-49aa-b357-72d8ba523c4f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:01.174412 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-78a67a45-5918-49aa-b357-72d8ba523c4f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:01.306260 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-78a67a45-5918-49aa-b357-72d8ba523c4f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:01.314838 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-78a67a45-5918-49aa-b357-72d8ba523c4f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.153058 Jul 20 23:03:01.315441 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 578/1148] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:03:01 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:03:02.333393 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a1a3a925-62fb-4564-8c9c-c558e8784363 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:02.334084 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a1a3a925-62fb-4564-8c9c-c558e8784363 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:02.340496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a1a3a925-62fb-4564-8c9c-c558e8784363 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:02.341117 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a1a3a925-62fb-4564-8c9c-c558e8784363 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:02.341774 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a1a3a925-62fb-4564-8c9c-c558e8784363 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:02.342206 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a1a3a925-62fb-4564-8c9c-c558e8784363 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:02.477558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a1a3a925-62fb-4564-8c9c-c558e8784363 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:02.485016 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a1a3a925-62fb-4564-8c9c-c558e8784363 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1359 microversion: 2.1 time: 0.156955 Jul 20 23:03:02.485577 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 571/1149] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:03:02 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:03:03.502522 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-cda16f36-27f8-4a6c-bae9-b9e9a5632ffe tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:03.503080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-cda16f36-27f8-4a6c-bae9-b9e9a5632ffe tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:03.509739 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cda16f36-27f8-4a6c-bae9-b9e9a5632ffe tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:03.510213 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cda16f36-27f8-4a6c-bae9-b9e9a5632ffe tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:03.510962 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cda16f36-27f8-4a6c-bae9-b9e9a5632ffe tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:03.511417 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-cda16f36-27f8-4a6c-bae9-b9e9a5632ffe tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:03.650520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-cda16f36-27f8-4a6c-bae9-b9e9a5632ffe tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:03.659239 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-cda16f36-27f8-4a6c-bae9-b9e9a5632ffe tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1549 microversion: 2.1 time: 0.161258 Jul 20 23:03:03.659836 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 579/1150] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:03:03 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:03:03.675856 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-36e726d6-2d41-4ebe-840b-00225c5b4148 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:03.676472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-36e726d6-2d41-4ebe-840b-00225c5b4148 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:03.682636 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-36e726d6-2d41-4ebe-840b-00225c5b4148 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:03.683127 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-36e726d6-2d41-4ebe-840b-00225c5b4148 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:03.683891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-36e726d6-2d41-4ebe-840b-00225c5b4148 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:03.684329 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-36e726d6-2d41-4ebe-840b-00225c5b4148 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:03.815863 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-36e726d6-2d41-4ebe-840b-00225c5b4148 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:03.823487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-36e726d6-2d41-4ebe-840b-00225c5b4148 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1549 microversion: 2.1 time: 0.151991 Jul 20 23:03:03.824076 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 572/1151] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:03:03 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 23:03:03.839659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:03.843096 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:03.844353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Searching by: {'deleted': False, 'project_id': '62f889bb65b048cb96e5548e4420df8f'} {{(pid=124913) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 23:03:03.850917 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:03.851404 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:03.852192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:03.852630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:03.944858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.multi_cell_list [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124913) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 23:03:04.045329 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c74cf66a-fcbc-4b18-a820-bc5accc226a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209365 Jul 20 23:03:04.045916 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 580/1152] 10.222.0.81 () {58 vars in 1124 bytes} [Wed Jul 20 23:03:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:03:04.056012 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-860834e1-e7f3-4d87-adf1-159cacd2f3a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:04.056681 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-860834e1-e7f3-4d87-adf1-159cacd2f3a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:04.063362 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-860834e1-e7f3-4d87-adf1-159cacd2f3a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:04.070817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-860834e1-e7f3-4d87-adf1-159cacd2f3a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:04.070817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-860834e1-e7f3-4d87-adf1-159cacd2f3a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:04.070817 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-860834e1-e7f3-4d87-adf1-159cacd2f3a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:04.191630 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-860834e1-e7f3-4d87-adf1-159cacd2f3a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:04.199099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-860834e1-e7f3-4d87-adf1-159cacd2f3a6 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1549 microversion: 2.1 time: 0.146927 Jul 20 23:03:04.199670 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 573/1153] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:03:04 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:03:07.298723 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7d3cf0f3-a61d-4cf2-b437-86bc4fecbaa8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd64509d-fc40-4dc4-95cd-b74950159b3e"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:03:07.299860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7d3cf0f3-a61d-4cf2-b437-86bc4fecbaa8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:07.306250 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7d3cf0f3-a61d-4cf2-b437-86bc4fecbaa8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:07.306675 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7d3cf0f3-a61d-4cf2-b437-86bc4fecbaa8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:07.307462 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7d3cf0f3-a61d-4cf2-b437-86bc4fecbaa8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:07.307889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7d3cf0f3-a61d-4cf2-b437-86bc4fecbaa8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:08.065918 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7d3cf0f3-a61d-4cf2-b437-86bc4fecbaa8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "POST /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770958 Jul 20 23:03:08.066716 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 581/1154] 10.222.0.81 () {60 vars in 1322 bytes} [Wed Jul 20 23:03:07 2022] POST /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:03:16.653365 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-041ab04f-1a0b-4d2f-b939-5e2f5d030713 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:16.653972 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-041ab04f-1a0b-4d2f-b939-5e2f5d030713 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:16.656568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:03:16.657797 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=66 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:03:16.662438 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-041ab04f-1a0b-4d2f-b939-5e2f5d030713 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:16.662884 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-041ab04f-1a0b-4d2f-b939-5e2f5d030713 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:16.663674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-041ab04f-1a0b-4d2f-b939-5e2f5d030713 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:16.664108 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-041ab04f-1a0b-4d2f-b939-5e2f5d030713 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:16.794268 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-041ab04f-1a0b-4d2f-b939-5e2f5d030713 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:16.802777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-041ab04f-1a0b-4d2f-b939-5e2f5d030713 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1595 microversion: 2.1 time: 0.153203 Jul 20 23:03:16.803372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 574/1155] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:03:16 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:03:19.148297 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:03:19.148787 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:03:19.149633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:03:19.209747 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-a23a2de7-4f08-4ea9-88b1-ebb026930ee3 req-e7bf930a-e546-4300-8f2f-22b4a73e741c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9b4a32-fe13-47b5-89cd-6daf89b808ab", "tag": "c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:03:19.217822 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-a23a2de7-4f08-4ea9-88b1-ebb026930ee3 req-e7bf930a-e546-4300-8f2f-22b4a73e741c service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:19.218263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-a23a2de7-4f08-4ea9-88b1-ebb026930ee3 req-e7bf930a-e546-4300-8f2f-22b4a73e741c service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:19.229466 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-a23a2de7-4f08-4ea9-88b1-ebb026930ee3 req-e7bf930a-e546-4300-8f2f-22b4a73e741c service nova] Creating event network-changed:c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab for instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab on hv-cinder-79987 Jul 20 23:03:19.234610 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-a23a2de7-4f08-4ea9-88b1-ebb026930ee3 req-e7bf930a-e546-4300-8f2f-22b4a73e741c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093088 Jul 20 23:03:19.236073 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 582/1156] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:03:21.842745 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-580463de-3f92-4404-9cd2-004051c7d9a4 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1299687961"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:03:21.847141 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-580463de-3f92-4404-9cd2-004051c7d9a4 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:21.849771 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-580463de-3f92-4404-9cd2-004051c7d9a4 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:21.850215 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-580463de-3f92-4404-9cd2-004051c7d9a4 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:21.850966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-580463de-3f92-4404-9cd2-004051c7d9a4 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:21.851423 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-580463de-3f92-4404-9cd2-004051c7d9a4 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:21.976828 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.network.security_group_api [None req-580463de-3f92-4404-9cd2-004051c7d9a4 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Adding security group b683e914-e85c-48ca-9b50-5b1af7e6357b to port c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab Jul 20 23:03:22.417034 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-580463de-3f92-4404-9cd2-004051c7d9a4 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "POST /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/action" status: 202 len: 0 microversion: 2.1 time: 0.577927 Jul 20 23:03:22.420702 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 575/1157] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 23:03:21 2022] POST /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 23:03:22.426852 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-215f5784-7b07-4381-b3a2-92c971388f01 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:03:22.429439 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-80877524-eafa-430e-be1a-f5bc60462628 req-1c733eac-094c-4e8d-b182-062f654a6176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9b4a32-fe13-47b5-89cd-6daf89b808ab", "tag": "c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:03:22.433181 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-215f5784-7b07-4381-b3a2-92c971388f01 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:03:22.443204 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-80877524-eafa-430e-be1a-f5bc60462628 req-1c733eac-094c-4e8d-b182-062f654a6176 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:22.443673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-215f5784-7b07-4381-b3a2-92c971388f01 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:22.444135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-215f5784-7b07-4381-b3a2-92c971388f01 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:22.444435 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-80877524-eafa-430e-be1a-f5bc60462628 req-1c733eac-094c-4e8d-b182-062f654a6176 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:22.444904 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-215f5784-7b07-4381-b3a2-92c971388f01 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:03:22.448744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-215f5784-7b07-4381-b3a2-92c971388f01 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:03:22.462929 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-80877524-eafa-430e-be1a-f5bc60462628 req-1c733eac-094c-4e8d-b182-062f654a6176 service nova] Creating event network-changed:c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab for instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab on hv-cinder-79987 Jul 20 23:03:22.468935 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-80877524-eafa-430e-be1a-f5bc60462628 req-1c733eac-094c-4e8d-b182-062f654a6176 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045292 Jul 20 23:03:22.472752 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 583/1158] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:03:22.635099 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-215f5784-7b07-4381-b3a2-92c971388f01 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:03:22.643454 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-215f5784-7b07-4381-b3a2-92c971388f01 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1761 microversion: 2.1 time: 0.221071 Jul 20 23:03:22.644261 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 576/1159] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:03:22 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1761 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:10.765468 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3dac394a-36da-4c1b-a352-c4a897c3667b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:04:10.766510 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3dac394a-36da-4c1b-a352-c4a897c3667b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:10.774050 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3dac394a-36da-4c1b-a352-c4a897c3667b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:10.774486 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3dac394a-36da-4c1b-a352-c4a897c3667b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:10.775276 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3dac394a-36da-4c1b-a352-c4a897c3667b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:10.775705 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3dac394a-36da-4c1b-a352-c4a897c3667b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:11.029343 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3dac394a-36da-4c1b-a352-c4a897c3667b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "POST /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/action" status: 202 len: 0 microversion: 2.1 time: 0.269203 Jul 20 23:04:11.029977 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 584/1160] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 23:04:10 2022] POST /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 23:04:11.037979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5a0f5b58-7fea-4380-8527-608c13c0fc31 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:11.038619 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-5a0f5b58-7fea-4380-8527-608c13c0fc31 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:11.040846 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=6 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:04:11.041499 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=16 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:04:11.046309 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5a0f5b58-7fea-4380-8527-608c13c0fc31 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:11.046754 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5a0f5b58-7fea-4380-8527-608c13c0fc31 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:11.047539 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5a0f5b58-7fea-4380-8527-608c13c0fc31 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:11.047966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5a0f5b58-7fea-4380-8527-608c13c0fc31 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:11.196594 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-5a0f5b58-7fea-4380-8527-608c13c0fc31 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:11.205217 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5a0f5b58-7fea-4380-8527-608c13c0fc31 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1753 microversion: 2.1 time: 0.170999 Jul 20 23:04:11.206040 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 577/1161] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:11 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:12.225145 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d163042d-0b93-4ccc-bd29-563c3407539e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:12.225843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d163042d-0b93-4ccc-bd29-563c3407539e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:12.231945 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d163042d-0b93-4ccc-bd29-563c3407539e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:12.232389 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d163042d-0b93-4ccc-bd29-563c3407539e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:12.233143 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d163042d-0b93-4ccc-bd29-563c3407539e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:12.233576 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d163042d-0b93-4ccc-bd29-563c3407539e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:12.381304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d163042d-0b93-4ccc-bd29-563c3407539e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:12.389433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d163042d-0b93-4ccc-bd29-563c3407539e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.169459 Jul 20 23:04:12.390002 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 585/1162] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:12 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:13.407367 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-06c1fe50-00d4-461c-b152-79171a019ab9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:13.408003 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-06c1fe50-00d4-461c-b152-79171a019ab9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:13.415176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-06c1fe50-00d4-461c-b152-79171a019ab9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:13.415620 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-06c1fe50-00d4-461c-b152-79171a019ab9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:13.416369 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-06c1fe50-00d4-461c-b152-79171a019ab9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:13.416800 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-06c1fe50-00d4-461c-b152-79171a019ab9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:13.558329 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-06c1fe50-00d4-461c-b152-79171a019ab9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:13.566316 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-06c1fe50-00d4-461c-b152-79171a019ab9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.162789 Jul 20 23:04:13.566874 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 578/1163] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:13 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:14.583276 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-3cff673e-e7cb-4dc7-9f60-f5029c4a167b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:14.583888 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-3cff673e-e7cb-4dc7-9f60-f5029c4a167b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:14.590948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3cff673e-e7cb-4dc7-9f60-f5029c4a167b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:14.591410 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3cff673e-e7cb-4dc7-9f60-f5029c4a167b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:14.592161 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3cff673e-e7cb-4dc7-9f60-f5029c4a167b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:14.592595 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-3cff673e-e7cb-4dc7-9f60-f5029c4a167b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:14.735779 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-3cff673e-e7cb-4dc7-9f60-f5029c4a167b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:14.744062 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-3cff673e-e7cb-4dc7-9f60-f5029c4a167b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.164564 Jul 20 23:04:14.744633 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 586/1164] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:14 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:15.761179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c72f99e3-6fb0-4030-a9d8-b0dab2691488 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:15.761804 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c72f99e3-6fb0-4030-a9d8-b0dab2691488 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:15.768397 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c72f99e3-6fb0-4030-a9d8-b0dab2691488 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:15.768846 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c72f99e3-6fb0-4030-a9d8-b0dab2691488 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:15.769614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c72f99e3-6fb0-4030-a9d8-b0dab2691488 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:15.770052 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c72f99e3-6fb0-4030-a9d8-b0dab2691488 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:15.916582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c72f99e3-6fb0-4030-a9d8-b0dab2691488 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:15.924490 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c72f99e3-6fb0-4030-a9d8-b0dab2691488 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.167527 Jul 20 23:04:15.925049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 579/1165] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:15 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:16.941764 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7788b970-0904-4f22-b4e4-c289064abf75 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:16.942377 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7788b970-0904-4f22-b4e4-c289064abf75 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:16.948573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7788b970-0904-4f22-b4e4-c289064abf75 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:16.949018 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7788b970-0904-4f22-b4e4-c289064abf75 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:16.949776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7788b970-0904-4f22-b4e4-c289064abf75 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:16.950249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7788b970-0904-4f22-b4e4-c289064abf75 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:17.095860 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7788b970-0904-4f22-b4e4-c289064abf75 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:17.105263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7788b970-0904-4f22-b4e4-c289064abf75 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.167457 Jul 20 23:04:17.105855 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 587/1166] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:16 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:18.123639 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-15601ce1-b39a-46d8-9400-6eabdbc302a9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:18.124234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-15601ce1-b39a-46d8-9400-6eabdbc302a9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:18.130674 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-15601ce1-b39a-46d8-9400-6eabdbc302a9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:18.131422 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-15601ce1-b39a-46d8-9400-6eabdbc302a9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:18.132174 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-15601ce1-b39a-46d8-9400-6eabdbc302a9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:18.132608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-15601ce1-b39a-46d8-9400-6eabdbc302a9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:18.274253 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-15601ce1-b39a-46d8-9400-6eabdbc302a9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:18.282264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-15601ce1-b39a-46d8-9400-6eabdbc302a9 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.162499 Jul 20 23:04:18.283357 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 580/1167] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:18 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:19.299776 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d67e1053-9048-4d24-9a40-244854dd1e7e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:19.300380 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d67e1053-9048-4d24-9a40-244854dd1e7e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:19.307456 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d67e1053-9048-4d24-9a40-244854dd1e7e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:19.307899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d67e1053-9048-4d24-9a40-244854dd1e7e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:19.308651 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d67e1053-9048-4d24-9a40-244854dd1e7e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:19.309084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d67e1053-9048-4d24-9a40-244854dd1e7e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:19.449466 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d67e1053-9048-4d24-9a40-244854dd1e7e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:19.458076 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d67e1053-9048-4d24-9a40-244854dd1e7e tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.162098 Jul 20 23:04:19.458645 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 588/1168] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:19 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:20.475314 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-80436c6e-7f89-432c-8c13-dec1115dbb18 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:20.475839 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-80436c6e-7f89-432c-8c13-dec1115dbb18 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:20.482786 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80436c6e-7f89-432c-8c13-dec1115dbb18 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:20.483264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80436c6e-7f89-432c-8c13-dec1115dbb18 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:20.484047 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80436c6e-7f89-432c-8c13-dec1115dbb18 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:20.484478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80436c6e-7f89-432c-8c13-dec1115dbb18 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:20.627417 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-80436c6e-7f89-432c-8c13-dec1115dbb18 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:20.635667 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-80436c6e-7f89-432c-8c13-dec1115dbb18 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.164317 Jul 20 23:04:20.636221 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 581/1169] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:20 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:21.653089 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ba6620b6-c9f1-4773-bc18-32938cee70d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:21.653691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ba6620b6-c9f1-4773-bc18-32938cee70d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:21.660561 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba6620b6-c9f1-4773-bc18-32938cee70d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:21.661119 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba6620b6-c9f1-4773-bc18-32938cee70d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:21.661868 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba6620b6-c9f1-4773-bc18-32938cee70d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:21.662291 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ba6620b6-c9f1-4773-bc18-32938cee70d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:21.810433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-ba6620b6-c9f1-4773-bc18-32938cee70d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:21.818550 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ba6620b6-c9f1-4773-bc18-32938cee70d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.169874 Jul 20 23:04:21.819140 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 589/1170] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:21 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:22.838656 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a18778cc-8309-480a-8a8b-e8eaa216e7dd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:22.839282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a18778cc-8309-480a-8a8b-e8eaa216e7dd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:22.846011 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a18778cc-8309-480a-8a8b-e8eaa216e7dd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:22.846455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a18778cc-8309-480a-8a8b-e8eaa216e7dd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:22.847260 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a18778cc-8309-480a-8a8b-e8eaa216e7dd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:22.847697 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a18778cc-8309-480a-8a8b-e8eaa216e7dd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:23.000638 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a18778cc-8309-480a-8a8b-e8eaa216e7dd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:23.008823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a18778cc-8309-480a-8a8b-e8eaa216e7dd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1758 microversion: 2.1 time: 0.174097 Jul 20 23:04:23.009387 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 582/1171] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:22 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:04:24.025805 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-aa1f86aa-9614-49d6-9f2f-b62656f027bd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:04:24.026939 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-aa1f86aa-9614-49d6-9f2f-b62656f027bd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:04:24.033426 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aa1f86aa-9614-49d6-9f2f-b62656f027bd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:24.033877 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aa1f86aa-9614-49d6-9f2f-b62656f027bd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:24.034638 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aa1f86aa-9614-49d6-9f2f-b62656f027bd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:04:24.035096 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aa1f86aa-9614-49d6-9f2f-b62656f027bd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:04:24.175508 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-aa1f86aa-9614-49d6-9f2f-b62656f027bd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:04:24.183493 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-aa1f86aa-9614-49d6-9f2f-b62656f027bd tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1761 microversion: 2.1 time: 0.161474 Jul 20 23:04:24.184055 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 590/1172] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:04:24 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1761 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:05:27.423348 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=12 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:05:27.424112 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=36 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:05:27.428078 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-21888119-7080-4924-9e6b-ca02e038633f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1299687961"}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:05:27.428614 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-21888119-7080-4924-9e6b-ca02e038633f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:27.434458 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-21888119-7080-4924-9e6b-ca02e038633f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:27.434907 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-21888119-7080-4924-9e6b-ca02e038633f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:27.435693 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-21888119-7080-4924-9e6b-ca02e038633f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:27.436128 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-21888119-7080-4924-9e6b-ca02e038633f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:27.670259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.network.security_group_api [None req-21888119-7080-4924-9e6b-ca02e038633f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Removing security group b683e914-e85c-48ca-9b50-5b1af7e6357b from port c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab Jul 20 23:05:28.062992 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-21888119-7080-4924-9e6b-ca02e038633f tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "POST /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/action" status: 202 len: 0 microversion: 2.1 time: 0.641339 Jul 20 23:05:28.066751 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 583/1173] 10.222.0.81 () {60 vars in 1277 bytes} [Wed Jul 20 23:05:27 2022] POST /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 23:05:28.071339 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=18 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:05:28.073303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:05:28.077354 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-8f021b28-d98e-4508-aa13-62339fb16b50 req-aa86d75f-53ae-4d9f-b2b8-aacfe618fc35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9b4a32-fe13-47b5-89cd-6daf89b808ab", "tag": "c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:05:28.092442 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-8f021b28-d98e-4508-aa13-62339fb16b50 req-aa86d75f-53ae-4d9f-b2b8-aacfe618fc35 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:28.092899 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-8f021b28-d98e-4508-aa13-62339fb16b50 req-aa86d75f-53ae-4d9f-b2b8-aacfe618fc35 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:28.109784 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-8f021b28-d98e-4508-aa13-62339fb16b50 req-aa86d75f-53ae-4d9f-b2b8-aacfe618fc35 service nova] Creating event network-changed:c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab for instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab on hv-cinder-79987 Jul 20 23:05:28.117351 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-8f021b28-d98e-4508-aa13-62339fb16b50 req-aa86d75f-53ae-4d9f-b2b8-aacfe618fc35 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049850 Jul 20 23:05:28.119315 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 591/1174] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:05:29.415816 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-356cb1c1-2616-4548-b1a9-ed49ed835e42 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:29.416359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-356cb1c1-2616-4548-b1a9-ed49ed835e42 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:29.422971 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-356cb1c1-2616-4548-b1a9-ed49ed835e42 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:29.423446 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-356cb1c1-2616-4548-b1a9-ed49ed835e42 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:29.424192 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-356cb1c1-2616-4548-b1a9-ed49ed835e42 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:29.424618 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-356cb1c1-2616-4548-b1a9-ed49ed835e42 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:29.503831 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-356cb1c1-2616-4548-b1a9-ed49ed835e42 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lazy-loading 'services' on Instance uuid fa9b4a32-fe13-47b5-89cd-6daf89b808ab {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 23:05:29.863445 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-356cb1c1-2616-4548-b1a9-ed49ed835e42 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments/fd64509d-fc40-4dc4-95cd-b74950159b3e" status: 202 len: 0 microversion: 2.1 time: 0.451916 Jul 20 23:05:29.864103 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 584/1175] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 23:05:29 2022] DELETE /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments/fd64509d-fc40-4dc4-95cd-b74950159b3e => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 23:05:29.874700 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e34eb87a-12ab-4093-b334-f157fb56f54b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:29.876263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e34eb87a-12ab-4093-b334-f157fb56f54b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:29.883984 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e34eb87a-12ab-4093-b334-f157fb56f54b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:29.884453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e34eb87a-12ab-4093-b334-f157fb56f54b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:29.885275 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e34eb87a-12ab-4093-b334-f157fb56f54b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:29.885709 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e34eb87a-12ab-4093-b334-f157fb56f54b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:29.915436 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e34eb87a-12ab-4093-b334-f157fb56f54b tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046673 Jul 20 23:05:29.916338 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 592/1176] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 23:05:29 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:05:30.136893 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-5931f187-ec5a-46c9-9ec6-73bdd7b1bfae req-7b4a3f44-1ed8-471b-96eb-954c2a1ec5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9b4a32-fe13-47b5-89cd-6daf89b808ab", "tag": "c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:05:30.146639 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5931f187-ec5a-46c9-9ec6-73bdd7b1bfae req-7b4a3f44-1ed8-471b-96eb-954c2a1ec5f5 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:30.147104 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5931f187-ec5a-46c9-9ec6-73bdd7b1bfae req-7b4a3f44-1ed8-471b-96eb-954c2a1ec5f5 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:30.158562 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-5931f187-ec5a-46c9-9ec6-73bdd7b1bfae req-7b4a3f44-1ed8-471b-96eb-954c2a1ec5f5 service nova] Creating event network-changed:c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab for instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab on hv-cinder-79987 Jul 20 23:05:30.163411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-5931f187-ec5a-46c9-9ec6-73bdd7b1bfae req-7b4a3f44-1ed8-471b-96eb-954c2a1ec5f5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030976 Jul 20 23:05:30.164007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 585/1177] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:05:30.928635 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-27b63fe0-7b39-495e-81d6-f2beba65bf8c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:30.929668 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-27b63fe0-7b39-495e-81d6-f2beba65bf8c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:30.937124 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27b63fe0-7b39-495e-81d6-f2beba65bf8c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:30.937572 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27b63fe0-7b39-495e-81d6-f2beba65bf8c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:30.938336 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27b63fe0-7b39-495e-81d6-f2beba65bf8c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:30.938769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-27b63fe0-7b39-495e-81d6-f2beba65bf8c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:30.966725 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-27b63fe0-7b39-495e-81d6-f2beba65bf8c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Jul 20 23:05:30.967340 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 593/1178] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 23:05:30 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:05:31.979733 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-795591c4-ed4b-4873-8356-d9cededda0d7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:31.980835 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-795591c4-ed4b-4873-8356-d9cededda0d7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:31.987712 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-795591c4-ed4b-4873-8356-d9cededda0d7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:31.988150 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-795591c4-ed4b-4873-8356-d9cededda0d7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:31.988890 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-795591c4-ed4b-4873-8356-d9cededda0d7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:31.989315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-795591c4-ed4b-4873-8356-d9cededda0d7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:32.017716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-795591c4-ed4b-4873-8356-d9cededda0d7 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043064 Jul 20 23:05:32.018254 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 586/1179] 10.222.0.81 () {58 vars in 1301 bytes} [Wed Jul 20 23:05:31 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 23:05:32.028053 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:32.029084 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:32.035942 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:32.036391 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:32.037150 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:32.037584 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:32.208344 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] HTTP exception thrown: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab is not attached to volume fd64509d-fc40-4dc4-95cd-b74950159b3e Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Request method failure captured: Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: DELETE /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments/fd64509d-fc40-4dc4-95cd-b74950159b3e HTTP/1.1 Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2Il8fEMwPK7Bbj553stKfJmh2ylj6uDKDKdqypy9ybXk1y0nTZS4DIDU7-jmLPizAUTpiYK4qp76d2FuIgbBzFdu3IefhyHoit10u9kID_nQPnSMD7TO2g8wZ4qFemLw_4V3K522TpNUV03pGMlrzHwhwD2lJEX5wm_5Tm2-FoJGRIA Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 62f889bb65b048cb96e5548e4420df8f Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-TestMinimumBasicScenario-475145308 Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 23:05:32.210676 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_62f889bb65b048cb96e5548e4420df8f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/62f889bb65b048cb96e5548e4420df8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/62f889bb65b048cb96e5548e4420df8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/62f889bb65b048cb96e5548e4420df8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-TestMinimumBasicScenario-475145308 Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 62f889bb65b048cb96e5548e4420df8f Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-TestMinimumBasicScenario-475145308 Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-TestMinimumBasicScenario-475145308-project Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 07feb13dc066470cae9d68d0d38d89cb Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-TestMinimumBasicScenario-475145308-project Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 23:05:32.212531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab is not attached to volume fd64509d-fc40-4dc4-95cd-b74950159b3e Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'server_id': 'fa9b4a32-fe13-47b5-89cd-6daf89b808ab', 'id': 'fd64509d-fc40-4dc4-95cd-b74950159b3e'} Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fd64509d-fc40-4dc4-95cd-b74950159b3e. Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:05:32.213374 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab is not attached to volume fd64509d-fc40-4dc4-95cd-b74950159b3e Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab is not attached to volume fd64509d-fc40-4dc4-95cd-b74950159b3e Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:05:32.214905 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Returning 404 to user: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab is not attached to volume fd64509d-fc40-4dc4-95cd-b74950159b3e {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:05:32.216699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-af6ed851-e229-4696-aeb5-70e95bc987c8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments/fd64509d-fc40-4dc4-95cd-b74950159b3e" status: 404 len: 154 microversion: 2.1 time: 0.188043 Jul 20 23:05:32.216699 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 594/1180] 10.222.0.81 () {58 vars in 1415 bytes} [Wed Jul 20 23:05:32 2022] DELETE /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab/os-volume_attachments/fd64509d-fc40-4dc4-95cd-b74950159b3e => generated 154 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 23:05:33.533538 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-80d618bd-336f-457c-a36c-0062aa483eb2 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:33.534062 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-80d618bd-336f-457c-a36c-0062aa483eb2 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:33.540122 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80d618bd-336f-457c-a36c-0062aa483eb2 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:33.550569 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80d618bd-336f-457c-a36c-0062aa483eb2 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:33.550569 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80d618bd-336f-457c-a36c-0062aa483eb2 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:33.550569 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-80d618bd-336f-457c-a36c-0062aa483eb2 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:33.566297 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-80d618bd-336f-457c-a36c-0062aa483eb2 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 23:05:33.875334 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-80d618bd-336f-457c-a36c-0062aa483eb2 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 204 len: 0 microversion: 2.1 time: 0.345336 Jul 20 23:05:33.875941 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 587/1181] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 23:05:33 2022] DELETE /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 23:05:33.884268 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2d58e327-87a9-44a1-b8c3-dca33b42702c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:33.884872 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2d58e327-87a9-44a1-b8c3-dca33b42702c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:33.893988 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2d58e327-87a9-44a1-b8c3-dca33b42702c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:33.895586 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2d58e327-87a9-44a1-b8c3-dca33b42702c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:33.896401 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2d58e327-87a9-44a1-b8c3-dca33b42702c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:33.897561 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2d58e327-87a9-44a1-b8c3-dca33b42702c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:34.038217 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2d58e327-87a9-44a1-b8c3-dca33b42702c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:05:34.046603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2d58e327-87a9-44a1-b8c3-dca33b42702c tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1555 microversion: 2.1 time: 0.166139 Jul 20 23:05:34.047192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 595/1182] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:05:33 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:05:34.809114 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:05:34.809366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:05:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:05:35.065193 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-3b9c0fc3-cc42-4644-9fad-9fc61ec88df8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:35.065803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-3b9c0fc3-cc42-4644-9fad-9fc61ec88df8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:35.072288 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b9c0fc3-cc42-4644-9fad-9fc61ec88df8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:35.072736 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b9c0fc3-cc42-4644-9fad-9fc61ec88df8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:35.073487 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b9c0fc3-cc42-4644-9fad-9fc61ec88df8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:35.073921 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-3b9c0fc3-cc42-4644-9fad-9fc61ec88df8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:35.208289 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-3b9c0fc3-cc42-4644-9fad-9fc61ec88df8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:05:35.215823 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-3b9c0fc3-cc42-4644-9fad-9fc61ec88df8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1555 microversion: 2.1 time: 0.154928 Jul 20 23:05:35.216389 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 588/1183] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:05:35 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:05:36.232659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0c254634-0d64-4599-8781-1928f9064cb5 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:36.233265 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0c254634-0d64-4599-8781-1928f9064cb5 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:36.239715 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0c254634-0d64-4599-8781-1928f9064cb5 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:36.240158 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0c254634-0d64-4599-8781-1928f9064cb5 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:36.240911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0c254634-0d64-4599-8781-1928f9064cb5 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:36.241339 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0c254634-0d64-4599-8781-1928f9064cb5 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:36.432552 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0c254634-0d64-4599-8781-1928f9064cb5 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:05:36.439949 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0c254634-0d64-4599-8781-1928f9064cb5 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1555 microversion: 2.1 time: 0.211144 Jul 20 23:05:36.442527 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 596/1184] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:05:36 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1555 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:05:36.592687 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-dc875394-6d43-4ed4-89bd-829274fe883f req-6647a33f-8fd1-4f1d-b5f0-6936b16507bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9b4a32-fe13-47b5-89cd-6daf89b808ab", "name": "network-vif-deleted", "tag": "c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:05:36.602085 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-dc875394-6d43-4ed4-89bd-829274fe883f req-6647a33f-8fd1-4f1d-b5f0-6936b16507bc service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:36.602558 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-dc875394-6d43-4ed4-89bd-829274fe883f req-6647a33f-8fd1-4f1d-b5f0-6936b16507bc service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:36.615107 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-dc875394-6d43-4ed4-89bd-829274fe883f req-6647a33f-8fd1-4f1d-b5f0-6936b16507bc service nova] Creating event network-vif-deleted:c9b7ad75-b8b9-4a7e-8207-b0357fd0a6ab for instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab on hv-cinder-79987 Jul 20 23:05:36.619870 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-dc875394-6d43-4ed4-89bd-829274fe883f req-6647a33f-8fd1-4f1d-b5f0-6936b16507bc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Jul 20 23:05:36.620447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 589/1185] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 23:05:37.456979 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:37.457577 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:37.463890 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:37.464331 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:37.465081 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:37.465513 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:37.497006 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:37.497449 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:37.497895 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.objects.instance [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lazy-loading 'fault' on Instance uuid fa9b4a32-fe13-47b5-89cd-6daf89b808ab {{(pid=124913) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 23:05:37.544562 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07feb13dc066470cae9d68d0d38d89cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62f889bb65b048cb96e5548e4420df8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:05:37.546447 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-10a31004-ebc4-4e83-b2af-74638ad575d8 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 200 len: 1349 microversion: 2.1 time: 0.093369 Jul 20 23:05:37.547032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 597/1186] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:05:37 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:05:38.565288 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:38.565989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] [instance: fa9b4a32-fe13-47b5-89cd-6daf89b808ab] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:05:38.572274 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:38.572721 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:38.573478 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:05:38.573912 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:05:38.586990 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] HTTP exception thrown: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab could not be found. Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Request method failure captured: Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab HTTP/1.1 Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2Il8fEMwPK7Bbj553stKfJmh2ylj6uDKDKdqypy9ybXk1y0nTZS4DIDU7-jmLPizAUTpiYK4qp76d2FuIgbBzFdu3IefhyHoit10u9kID_nQPnSMD7TO2g8wZ4qFemLw_4V3K522TpNUV03pGMlrzHwhwD2lJEX5wm_5Tm2-FoJGRIA Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 62f889bb65b048cb96e5548e4420df8f Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-TestMinimumBasicScenario-475145308 Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 23:05:38.588616 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_62f889bb65b048cb96e5548e4420df8f", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/62f889bb65b048cb96e5548e4420df8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/62f889bb65b048cb96e5548e4420df8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/62f889bb65b048cb96e5548e4420df8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-TestMinimumBasicScenario-475145308 Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 62f889bb65b048cb96e5548e4420df8f Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-TestMinimumBasicScenario-475145308 Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-TestMinimumBasicScenario-475145308-project Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 07feb13dc066470cae9d68d0d38d89cb Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-TestMinimumBasicScenario-475145308-project Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab could not be found. Jul 20 23:05:38.590471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'fa9b4a32-fe13-47b5-89cd-6daf89b808ab'} Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab could not be found. Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:05:38.591649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab could not be found. Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab could not be found. Jul 20 23:05:38.593129 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:05:38.594901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Returning 404 to user: Instance fa9b4a32-fe13-47b5-89cd-6daf89b808ab could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:05:38.594901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ffc36c53-0b65-4060-8dff-bbb85dd1a6e1 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab" status: 404 len: 111 microversion: 2.1 time: 0.030066 Jul 20 23:05:38.594901 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 590/1187] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:05:38 2022] GET /compute/v2.1/servers/fa9b4a32-fe13-47b5-89cd-6daf89b808ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 23:05:38.598715 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-56188587-c349-416b-af31-99e65f988b02 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] Calling method '.version_select at 0x7fe243fd58b0>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:05:38.692974 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-56188587-c349-416b-af31-99e65f988b02 tempest-TestMinimumBasicScenario-475145308 tempest-TestMinimumBasicScenario-475145308-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1824065508" status: 202 len: 0 microversion: 2.1 time: 0.098028 Jul 20 23:05:38.693773 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 598/1188] 10.222.0.81 () {58 vars in 1271 bytes} [Wed Jul 20 23:05:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1824065508 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 23:05:41.248811 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:05:41.249474 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:05:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:05:45.550067 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:05:45.550622 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:06:02.103335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:02.104135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:02.274885 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d9414adf-8636-45cd-ab71-466f5574f660 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Action: 'create', calling method: .version_select at 0x7fe243f500d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-648746233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRzOExzXmx6V4LkLPcdi6am58dEtUehimeH6GBhuzxJqsDSGXPW9/1ux2AMoZh8xcjHyyx4gOAnbQTvlba40N2+mvPkghgOAyOGZg84QlZdsJHYRB9nxfLZuh01ES8iPw=="}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:06:02.290453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-d9414adf-8636-45cd-ab71-466f5574f660 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Getting quotas for project 9044845bc9d34e1e8794a43dda688527. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 23:06:02.295422 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-d9414adf-8636-45cd-ab71-466f5574f660 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Getting quotas for user 13390807045f4acdbbe4ea77af4dbb52 and project 9044845bc9d34e1e8794a43dda688527. Resources: {'key_pairs'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 23:06:02.412813 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d9414adf-8636-45cd-ab71-466f5574f660 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.314491 Jul 20 23:06:02.413498 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 591/1189] 10.222.0.81 () {60 vars in 1158 bytes} [Wed Jul 20 23:06:02 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:06:27.085848 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=40 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:27.086734 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:27.090583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1404895204", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-648746233", "security_groups": [{"name": "tempest-secgroup-smoke-1006332140"}], "block_device_mapping_v2": [{"uuid": "f378790f-977f-42eb-96cb-4123f2b88db5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "393bfb36-cc5b-4cce-9cdb-4858c0a973cc"}]}} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:06:27.204373 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.network.neutron [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] validate_networks() for [('393bfb36-cc5b-4cce-9cdb-4858c0a973cc', None, None, None, None, None)] {{(pid=124913) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 23:06:27.658009 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Flavor limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 23:06:27.658432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Image limits 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 23:06:27.658902 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Flavor pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 23:06:27.659353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Image pref 0:0:0 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 23:06:27.659762 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.virt.hardware [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124913) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 23:06:27.668578 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:27.669017 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:27.669800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:27.670228 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:27.686362 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Getting quotas for project 9044845bc9d34e1e8794a43dda688527. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 23:06:27.690769 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.quota [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Getting quotas for user 13390807045f4acdbbe4ea77af4dbb52 and project 9044845bc9d34e1e8794a43dda688527. Resources: {'ram', 'cores', 'instances'} {{(pid=124913) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 23:06:27.745883 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Going to run 1 instances... {{(pid=124913) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 23:06:27.747970 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f378790f-977f-42eb-96cb-4123f2b88db5',volume_size=None,volume_type=None)] {{(pid=124913) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 23:06:28.200683 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6455a2e9-217f-4736-9b58-c6dce30af81b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.115999 Jul 20 23:06:28.201680 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 599/1190] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 23:06:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 23:06:28.211722 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b92ac906-ce4e-44c0-a02e-a8fbbbdb7918 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:28.212369 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b92ac906-ce4e-44c0-a02e-a8fbbbdb7918 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:28.214391 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=4 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:28.215377 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:28.269989 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-b92ac906-ce4e-44c0-a02e-a8fbbbdb7918 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:28.277169 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b92ac906-ce4e-44c0-a02e-a8fbbbdb7918 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1094 microversion: 2.1 time: 0.069775 Jul 20 23:06:28.277746 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 592/1191] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:28 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:29.295151 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-92c8a10a-773d-4e32-9e5e-fb9be97bc84e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:29.295738 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-92c8a10a-773d-4e32-9e5e-fb9be97bc84e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:29.301792 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-92c8a10a-773d-4e32-9e5e-fb9be97bc84e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:29.302235 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-92c8a10a-773d-4e32-9e5e-fb9be97bc84e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:29.302980 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-92c8a10a-773d-4e32-9e5e-fb9be97bc84e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:29.303429 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-92c8a10a-773d-4e32-9e5e-fb9be97bc84e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:29.365042 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-92c8a10a-773d-4e32-9e5e-fb9be97bc84e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:29.372638 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-92c8a10a-773d-4e32-9e5e-fb9be97bc84e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1144 microversion: 2.1 time: 0.081920 Jul 20 23:06:29.373185 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 600/1192] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:29 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:30.395894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-5f156fe4-93bf-4ac0-96c9-a1a825ad3fee tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:30.397179 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-5f156fe4-93bf-4ac0-96c9-a1a825ad3fee tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:30.404801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5f156fe4-93bf-4ac0-96c9-a1a825ad3fee tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:30.405249 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5f156fe4-93bf-4ac0-96c9-a1a825ad3fee tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:30.406015 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5f156fe4-93bf-4ac0-96c9-a1a825ad3fee tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:30.406447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-5f156fe4-93bf-4ac0-96c9-a1a825ad3fee tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:30.468535 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-5f156fe4-93bf-4ac0-96c9-a1a825ad3fee tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:30.476280 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-5f156fe4-93bf-4ac0-96c9-a1a825ad3fee tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1200 microversion: 2.1 time: 0.084863 Jul 20 23:06:30.486238 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 593/1193] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:30 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:31.493567 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d23b066d-2733-482a-b7a3-439a1282946e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:31.494187 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d23b066d-2733-482a-b7a3-439a1282946e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:31.501167 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d23b066d-2733-482a-b7a3-439a1282946e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:31.502022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d23b066d-2733-482a-b7a3-439a1282946e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:31.503270 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d23b066d-2733-482a-b7a3-439a1282946e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:31.503871 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-d23b066d-2733-482a-b7a3-439a1282946e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:31.723192 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d23b066d-2733-482a-b7a3-439a1282946e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:31.730603 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d23b066d-2733-482a-b7a3-439a1282946e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1278 microversion: 2.1 time: 0.241272 Jul 20 23:06:31.731190 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 601/1194] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:31 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:32.175704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-5563f2e5-05f1-4a49-9d47-9acf1c42a2ed req-3484eaeb-380c-4500-aabb-da5fbb27468f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2a654b-6f72-4edd-818a-4ed2fd111741", "tag": "4cc0beea-905e-43bc-ac0a-52fa8b9cea88"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:06:32.187114 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5563f2e5-05f1-4a49-9d47-9acf1c42a2ed req-3484eaeb-380c-4500-aabb-da5fbb27468f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:32.188058 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-5563f2e5-05f1-4a49-9d47-9acf1c42a2ed req-3484eaeb-380c-4500-aabb-da5fbb27468f service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:32.218485 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-5563f2e5-05f1-4a49-9d47-9acf1c42a2ed req-3484eaeb-380c-4500-aabb-da5fbb27468f service nova] Creating event network-changed:4cc0beea-905e-43bc-ac0a-52fa8b9cea88 for instance ac2a654b-6f72-4edd-818a-4ed2fd111741 on hv-cinder-79987 Jul 20 23:06:32.218485 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-5563f2e5-05f1-4a49-9d47-9acf1c42a2ed req-3484eaeb-380c-4500-aabb-da5fbb27468f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043594 Jul 20 23:06:32.218485 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 594/1195] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:06:32.749421 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-52563d43-9927-4c14-a910-687709efd069 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:32.750022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-52563d43-9927-4c14-a910-687709efd069 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:32.756611 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-52563d43-9927-4c14-a910-687709efd069 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:32.757045 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-52563d43-9927-4c14-a910-687709efd069 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:32.757791 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-52563d43-9927-4c14-a910-687709efd069 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:32.758215 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-52563d43-9927-4c14-a910-687709efd069 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:32.983973 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-52563d43-9927-4c14-a910-687709efd069 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:32.991604 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-52563d43-9927-4c14-a910-687709efd069 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.245944 Jul 20 23:06:32.992177 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 602/1196] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:32 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:34.010022 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-09fc10e4-247d-4824-b94a-01e43e9accfc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:34.010726 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-09fc10e4-247d-4824-b94a-01e43e9accfc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:34.016930 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-09fc10e4-247d-4824-b94a-01e43e9accfc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:34.017381 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-09fc10e4-247d-4824-b94a-01e43e9accfc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:34.018144 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-09fc10e4-247d-4824-b94a-01e43e9accfc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:34.018584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-09fc10e4-247d-4824-b94a-01e43e9accfc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:34.152276 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-09fc10e4-247d-4824-b94a-01e43e9accfc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:34.160357 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-09fc10e4-247d-4824-b94a-01e43e9accfc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.155076 Jul 20 23:06:34.160916 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 595/1197] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:34 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:35.177205 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-53d97e62-44f1-4c07-be34-fb8f7bbc2892 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:35.179312 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-53d97e62-44f1-4c07-be34-fb8f7bbc2892 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:35.185886 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53d97e62-44f1-4c07-be34-fb8f7bbc2892 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:35.186372 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53d97e62-44f1-4c07-be34-fb8f7bbc2892 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:35.187190 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53d97e62-44f1-4c07-be34-fb8f7bbc2892 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:35.187623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-53d97e62-44f1-4c07-be34-fb8f7bbc2892 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:35.318876 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-53d97e62-44f1-4c07-be34-fb8f7bbc2892 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:35.326320 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-53d97e62-44f1-4c07-be34-fb8f7bbc2892 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.153560 Jul 20 23:06:35.338398 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 603/1198] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:35 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:36.343130 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-6ba83f46-68dd-46e1-bdf7-b3571275a345 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:36.343739 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-6ba83f46-68dd-46e1-bdf7-b3571275a345 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:36.350279 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6ba83f46-68dd-46e1-bdf7-b3571275a345 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:36.350727 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6ba83f46-68dd-46e1-bdf7-b3571275a345 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:36.351564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6ba83f46-68dd-46e1-bdf7-b3571275a345 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:36.351932 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-6ba83f46-68dd-46e1-bdf7-b3571275a345 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:36.481871 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-6ba83f46-68dd-46e1-bdf7-b3571275a345 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:36.490015 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-6ba83f46-68dd-46e1-bdf7-b3571275a345 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.150764 Jul 20 23:06:36.490582 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 596/1199] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:36 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:37.507516 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-18a08991-ece9-4997-a10c-8be949c95894 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:37.508156 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-18a08991-ece9-4997-a10c-8be949c95894 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:37.514563 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-18a08991-ece9-4997-a10c-8be949c95894 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:37.515029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-18a08991-ece9-4997-a10c-8be949c95894 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:37.515777 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-18a08991-ece9-4997-a10c-8be949c95894 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:37.516201 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-18a08991-ece9-4997-a10c-8be949c95894 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:37.645249 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-18a08991-ece9-4997-a10c-8be949c95894 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:37.652922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-18a08991-ece9-4997-a10c-8be949c95894 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.149242 Jul 20 23:06:37.653794 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 604/1200] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:37 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 23:06:38.669604 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-53e00b16-4019-4c7a-8439-99af92f27979 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:38.670256 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-53e00b16-4019-4c7a-8439-99af92f27979 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:38.677419 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-53e00b16-4019-4c7a-8439-99af92f27979 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:38.677868 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-53e00b16-4019-4c7a-8439-99af92f27979 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:38.678632 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-53e00b16-4019-4c7a-8439-99af92f27979 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:38.679100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-53e00b16-4019-4c7a-8439-99af92f27979 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:38.812406 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-53e00b16-4019-4c7a-8439-99af92f27979 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:38.819879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-53e00b16-4019-4c7a-8439-99af92f27979 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.154130 Jul 20 23:06:38.820436 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 597/1201] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:38 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:39.836058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-89701716-7679-471d-a94b-29c9eeac78fd tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:39.836662 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-89701716-7679-471d-a94b-29c9eeac78fd tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:39.839725 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:39.840560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=6 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:39.845749 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-89701716-7679-471d-a94b-29c9eeac78fd tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:39.849386 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-89701716-7679-471d-a94b-29c9eeac78fd tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:39.849386 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-89701716-7679-471d-a94b-29c9eeac78fd tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:39.849386 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-89701716-7679-471d-a94b-29c9eeac78fd tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:39.982209 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-89701716-7679-471d-a94b-29c9eeac78fd tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:39.990100 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-89701716-7679-471d-a94b-29c9eeac78fd tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.157881 Jul 20 23:06:39.990655 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 605/1202] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:39 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:41.007100 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ad2548ef-964e-48a0-a103-2e9355d1bbcc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:41.007704 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ad2548ef-964e-48a0-a103-2e9355d1bbcc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:41.010064 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:41.015004 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ad2548ef-964e-48a0-a103-2e9355d1bbcc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:41.015482 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ad2548ef-964e-48a0-a103-2e9355d1bbcc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:41.016282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ad2548ef-964e-48a0-a103-2e9355d1bbcc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:41.016680 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ad2548ef-964e-48a0-a103-2e9355d1bbcc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:41.153801 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ad2548ef-964e-48a0-a103-2e9355d1bbcc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:41.161796 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ad2548ef-964e-48a0-a103-2e9355d1bbcc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.158633 Jul 20 23:06:41.162357 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 598/1203] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:41 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:42.179359 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-7821826d-ce69-4b89-aa9b-779b2229c376 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:42.179900 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-7821826d-ce69-4b89-aa9b-779b2229c376 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:42.185995 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7821826d-ce69-4b89-aa9b-779b2229c376 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:42.186434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7821826d-ce69-4b89-aa9b-779b2229c376 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:42.187262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7821826d-ce69-4b89-aa9b-779b2229c376 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:42.187690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-7821826d-ce69-4b89-aa9b-779b2229c376 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:42.322586 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-7821826d-ce69-4b89-aa9b-779b2229c376 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:42.329757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-7821826d-ce69-4b89-aa9b-779b2229c376 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.155038 Jul 20 23:06:42.330569 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 606/1204] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:42 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:43.345799 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-376dd2cb-eb97-4830-afce-4b029b0e8b6b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:43.346942 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-376dd2cb-eb97-4830-afce-4b029b0e8b6b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:43.353425 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-376dd2cb-eb97-4830-afce-4b029b0e8b6b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:43.353871 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-376dd2cb-eb97-4830-afce-4b029b0e8b6b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:43.354618 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-376dd2cb-eb97-4830-afce-4b029b0e8b6b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:43.355076 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-376dd2cb-eb97-4830-afce-4b029b0e8b6b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:43.489993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-376dd2cb-eb97-4830-afce-4b029b0e8b6b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:43.497485 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-376dd2cb-eb97-4830-afce-4b029b0e8b6b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.155559 Jul 20 23:06:43.498043 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 599/1205] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:43 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:43.857941 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-c598e14b-1da8-4f97-ad0d-e936c632eec8 req-fce0b252-d1dd-4980-8d39-a5f6eabf225d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2a654b-6f72-4edd-818a-4ed2fd111741", "name": "network-vif-plugged", "status": "completed", "tag": "4cc0beea-905e-43bc-ac0a-52fa8b9cea88"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:06:43.859652 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-c598e14b-1da8-4f97-ad0d-e936c632eec8 req-fce0b252-d1dd-4980-8d39-a5f6eabf225d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:43.860098 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-c598e14b-1da8-4f97-ad0d-e936c632eec8 req-fce0b252-d1dd-4980-8d39-a5f6eabf225d service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:43.872075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-c598e14b-1da8-4f97-ad0d-e936c632eec8 req-fce0b252-d1dd-4980-8d39-a5f6eabf225d service nova] Creating event network-vif-plugged:4cc0beea-905e-43bc-ac0a-52fa8b9cea88 for instance ac2a654b-6f72-4edd-818a-4ed2fd111741 on hv-cinder-79987 Jul 20 23:06:43.879361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-c598e14b-1da8-4f97-ad0d-e936c632eec8 req-fce0b252-d1dd-4980-8d39-a5f6eabf225d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091280 Jul 20 23:06:43.880865 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 607/1206] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:06:44.515186 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-63acc555-e37f-4404-a8cb-4e477a799a7b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:44.515752 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-63acc555-e37f-4404-a8cb-4e477a799a7b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:44.522283 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-63acc555-e37f-4404-a8cb-4e477a799a7b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:44.522720 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-63acc555-e37f-4404-a8cb-4e477a799a7b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:44.523496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-63acc555-e37f-4404-a8cb-4e477a799a7b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:44.523924 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-63acc555-e37f-4404-a8cb-4e477a799a7b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:44.655092 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-63acc555-e37f-4404-a8cb-4e477a799a7b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:44.662966 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-63acc555-e37f-4404-a8cb-4e477a799a7b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.151898 Jul 20 23:06:44.663542 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 600/1207] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:44 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:45.681145 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-018512f1-33ab-45b9-8731-8ea552b8a138 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:45.681843 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-018512f1-33ab-45b9-8731-8ea552b8a138 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:45.688107 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-018512f1-33ab-45b9-8731-8ea552b8a138 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:45.688496 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-018512f1-33ab-45b9-8731-8ea552b8a138 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:45.689256 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-018512f1-33ab-45b9-8731-8ea552b8a138 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:45.689691 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-018512f1-33ab-45b9-8731-8ea552b8a138 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:45.818507 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-018512f1-33ab-45b9-8731-8ea552b8a138 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:45.826065 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-018512f1-33ab-45b9-8731-8ea552b8a138 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1266 microversion: 2.1 time: 0.149536 Jul 20 23:06:45.826630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 608/1208] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:45 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:46.843453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e8d92efa-7c1e-4d78-91cd-aac4a954adba tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:46.844067 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e8d92efa-7c1e-4d78-91cd-aac4a954adba tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:46.851085 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8d92efa-7c1e-4d78-91cd-aac4a954adba tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:46.851547 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8d92efa-7c1e-4d78-91cd-aac4a954adba tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:46.852296 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8d92efa-7c1e-4d78-91cd-aac4a954adba tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:46.852872 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e8d92efa-7c1e-4d78-91cd-aac4a954adba tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:46.980860 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e8d92efa-7c1e-4d78-91cd-aac4a954adba tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:46.988908 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e8d92efa-7c1e-4d78-91cd-aac4a954adba tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1453 microversion: 2.1 time: 0.149312 Jul 20 23:06:46.989468 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 601/1209] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:46 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:47.004989 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-2dd2205f-6d82-4632-9f21-b2c4a6e0a12f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:06:47.005599 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-2dd2205f-6d82-4632-9f21-b2c4a6e0a12f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:06:47.012117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2dd2205f-6d82-4632-9f21-b2c4a6e0a12f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:47.012573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2dd2205f-6d82-4632-9f21-b2c4a6e0a12f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:47.013333 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2dd2205f-6d82-4632-9f21-b2c4a6e0a12f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:47.013766 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-2dd2205f-6d82-4632-9f21-b2c4a6e0a12f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:47.152609 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-2dd2205f-6d82-4632-9f21-b2c4a6e0a12f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:06:47.160656 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-2dd2205f-6d82-4632-9f21-b2c4a6e0a12f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1453 microversion: 2.1 time: 0.159790 Jul 20 23:06:47.161214 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 609/1210] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:06:46 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:06:49.418529 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-3302df81-52a4-485a-b849-9fa9793a7cc2 req-2e1f6b8c-9fc7-4ef8-bdfd-0a9c30b17e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac2a654b-6f72-4edd-818a-4ed2fd111741", "tag": "4cc0beea-905e-43bc-ac0a-52fa8b9cea88"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:06:49.427695 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-3302df81-52a4-485a-b849-9fa9793a7cc2 req-2e1f6b8c-9fc7-4ef8-bdfd-0a9c30b17e91 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:06:49.428136 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-3302df81-52a4-485a-b849-9fa9793a7cc2 req-2e1f6b8c-9fc7-4ef8-bdfd-0a9c30b17e91 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:06:49.439259 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-3302df81-52a4-485a-b849-9fa9793a7cc2 req-2e1f6b8c-9fc7-4ef8-bdfd-0a9c30b17e91 service nova] Creating event network-changed:4cc0beea-905e-43bc-ac0a-52fa8b9cea88 for instance ac2a654b-6f72-4edd-818a-4ed2fd111741 on hv-cinder-79987 Jul 20 23:06:49.444519 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-3302df81-52a4-485a-b849-9fa9793a7cc2 req-2e1f6b8c-9fc7-4ef8-bdfd-0a9c30b17e91 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029712 Jul 20 23:06:49.445440 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 602/1211] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:08:54.817075 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:08:54.817679 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:08:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:09:01.258608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:09:01.259187 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:09:01.408421 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:09:01.413842 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:09:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:09:03.091459 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:09:03.092220 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=58 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:09:03.096453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-85cb88f6-d7b3-4cef-9027-63ab2f43a82d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:03.096942 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-85cb88f6-d7b3-4cef-9027-63ab2f43a82d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:03.102714 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-85cb88f6-d7b3-4cef-9027-63ab2f43a82d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:03.107774 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-85cb88f6-d7b3-4cef-9027-63ab2f43a82d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:03.107774 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-85cb88f6-d7b3-4cef-9027-63ab2f43a82d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:03.107774 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-85cb88f6-d7b3-4cef-9027-63ab2f43a82d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:03.129030 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-85cb88f6-d7b3-4cef-9027-63ab2f43a82d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Going to try to terminate instance {{(pid=124913) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 23:09:03.496250 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-85cb88f6-d7b3-4cef-9027-63ab2f43a82d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 204 len: 0 microversion: 2.1 time: 0.406492 Jul 20 23:09:03.496889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 610/1212] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 23:09:03 2022] DELETE /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 23:09:03.503898 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b944fcde-cffa-4223-ba14-712335b48a1b] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 23:09:03.505254 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=24 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:09:03.505991 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=52 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:09:03.509998 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9db915f0-5bcb-47ec-9410-f17e9268fd37 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:03.511495 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9db915f0-5bcb-47ec-9410-f17e9268fd37 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:03.517644 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9db915f0-5bcb-47ec-9410-f17e9268fd37 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:03.518093 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9db915f0-5bcb-47ec-9410-f17e9268fd37 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:03.519098 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9db915f0-5bcb-47ec-9410-f17e9268fd37 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:03.519538 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9db915f0-5bcb-47ec-9410-f17e9268fd37 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:03.657858 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9db915f0-5bcb-47ec-9410-f17e9268fd37 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:03.665466 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9db915f0-5bcb-47ec-9410-f17e9268fd37 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1578 microversion: 2.1 time: 0.163690 Jul 20 23:09:03.666027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 603/1213] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:03 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:04.683346 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e3340173-e67c-45be-8e6f-68b6a3a23bd3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:04.684041 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e3340173-e67c-45be-8e6f-68b6a3a23bd3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:04.690433 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3340173-e67c-45be-8e6f-68b6a3a23bd3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:04.694670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3340173-e67c-45be-8e6f-68b6a3a23bd3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:04.694670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3340173-e67c-45be-8e6f-68b6a3a23bd3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:04.694670 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e3340173-e67c-45be-8e6f-68b6a3a23bd3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:04.832112 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e3340173-e67c-45be-8e6f-68b6a3a23bd3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:04.840301 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e3340173-e67c-45be-8e6f-68b6a3a23bd3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1578 microversion: 2.1 time: 0.161213 Jul 20 23:09:04.840857 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 611/1214] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:04 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:05.559139 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:09:05.559656 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:09:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:09:05.858140 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-f39abac3-865c-4ad4-9031-c65797cda072 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:05.858744 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-f39abac3-865c-4ad4-9031-c65797cda072 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:05.867501 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f39abac3-865c-4ad4-9031-c65797cda072 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:05.870891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f39abac3-865c-4ad4-9031-c65797cda072 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:05.870891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f39abac3-865c-4ad4-9031-c65797cda072 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:05.870891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-f39abac3-865c-4ad4-9031-c65797cda072 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:05.875868 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] [b944fcde-cffa-4223-ba14-712335b48a1b] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 48642. Jul 20 23:09:05.934779 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-f39abac3-865c-4ad4-9031-c65797cda072 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:05.943114 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-f39abac3-865c-4ad4-9031-c65797cda072 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1510 microversion: 2.1 time: 0.089236 Jul 20 23:09:05.943568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 604/1215] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:05 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1510 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:06.285039 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-a84ab4e1-df8a-4104-9b86-7275c3320954 req-ea2136fd-d227-46ae-a017-6378f97b9ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac2a654b-6f72-4edd-818a-4ed2fd111741", "name": "network-vif-deleted", "tag": "4cc0beea-905e-43bc-ac0a-52fa8b9cea88"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:09:06.293401 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-a84ab4e1-df8a-4104-9b86-7275c3320954 req-ea2136fd-d227-46ae-a017-6378f97b9ae1 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:06.293841 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-a84ab4e1-df8a-4104-9b86-7275c3320954 req-ea2136fd-d227-46ae-a017-6378f97b9ae1 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:06.305849 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-a84ab4e1-df8a-4104-9b86-7275c3320954 req-ea2136fd-d227-46ae-a017-6378f97b9ae1 service nova] Creating event network-vif-deleted:4cc0beea-905e-43bc-ac0a-52fa8b9cea88 for instance ac2a654b-6f72-4edd-818a-4ed2fd111741 on hv-cinder-79987 Jul 20 23:09:06.312138 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-a84ab4e1-df8a-4104-9b86-7275c3320954 req-ea2136fd-d227-46ae-a017-6378f97b9ae1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088201 Jul 20 23:09:06.313269 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 612/1216] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:09:06.960468 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:06.961088 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:06.969337 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:06.969877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:06.970828 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:06.971431 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:07.006828 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:07.007412 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:07.007938 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lazy-loading 'fault' on Instance uuid ac2a654b-6f72-4edd-818a-4ed2fd111741 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 23:09:07.052719 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:07.062443 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4e43b857-88ae-4a3d-924c-ceed347741be tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 200 len: 1230 microversion: 2.1 time: 0.105658 Jul 20 23:09:07.062973 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 605/1217] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:06 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 23:09:08.080484 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:08.081212 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:08.087838 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:08.088288 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:08.089085 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:08.089514 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:08.102520 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] HTTP exception thrown: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Request method failure captured: Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 HTTP/1.1 Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IpTjISVBLuMwzxzq_uhOBtFwC0daWVO11LfDtIkBLweKxqWyh3Kt6IQFrjNnhCWlaN7JFYahQs1BdPn6uDgK3SbUMAq7Au9Usja-UWa0DxOAEHWB6GaS75iKYLYPNKEtP9jv2VrMGYkmy2xvFMr80ieizJgz_eGevMFc0FZtAjKcvU Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 23:09:08.104229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9044845bc9d34e1e8794a43dda688527", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 13390807045f4acdbbe4ea77af4dbb52 Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:09:08.106032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'ac2a654b-6f72-4edd-818a-4ed2fd111741'} Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:09:08.107117 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:09:08.108807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:09:08.110308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Returning 404 to user: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:09:08.110308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6384acb7-9bfe-422c-a2c5-eaa14f488e1c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 404 len: 111 microversion: 2.1 time: 0.029351 Jul 20 23:09:08.110308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 613/1218] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:08 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 23:09:08.153372 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-935344921", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-648746233", "security_groups": [{"name": "tempest-secgroup-smoke-1006332140"}], "block_device_mapping_v2": [{"uuid": "f378790f-977f-42eb-96cb-4123f2b88db5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "393bfb36-cc5b-4cce-9cdb-4858c0a973cc"}]}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:09:08.264641 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] validate_networks() for [('393bfb36-cc5b-4cce-9cdb-4858c0a973cc', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 23:09:08.680256 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 23:09:08.680680 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 23:09:08.681148 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 23:09:08.681548 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 23:09:08.681953 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 23:09:08.691220 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:08.691655 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:08.692470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:08.692894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:08.716857 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Getting quotas for project 9044845bc9d34e1e8794a43dda688527. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 23:09:08.722731 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Getting quotas for user 13390807045f4acdbbe4ea77af4dbb52 and project 9044845bc9d34e1e8794a43dda688527. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 23:09:08.782844 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 23:09:08.784937 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f378790f-977f-42eb-96cb-4123f2b88db5',volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 23:09:09.246514 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9c98b9be-9e0a-4949-aab1-4dcf8018330b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.097048 Jul 20 23:09:09.247247 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 606/1219] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 23:09:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 23:09:09.257315 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-d1453707-7b9d-40ed-a29a-12b368394e9b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:09.257925 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-d1453707-7b9d-40ed-a29a-12b368394e9b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:09.314530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-d1453707-7b9d-40ed-a29a-12b368394e9b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:09.321461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-d1453707-7b9d-40ed-a29a-12b368394e9b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1093 microversion: 2.1 time: 0.067883 Jul 20 23:09:09.322024 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 614/1220] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:09 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:10.339584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-e238df6d-8be8-4335-a4f3-c053a2c0b936 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:10.340183 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-e238df6d-8be8-4335-a4f3-c053a2c0b936 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:10.346439 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e238df6d-8be8-4335-a4f3-c053a2c0b936 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:10.346880 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e238df6d-8be8-4335-a4f3-c053a2c0b936 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:10.347725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e238df6d-8be8-4335-a4f3-c053a2c0b936 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:10.348148 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-e238df6d-8be8-4335-a4f3-c053a2c0b936 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:10.409249 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-e238df6d-8be8-4335-a4f3-c053a2c0b936 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:10.417170 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-e238df6d-8be8-4335-a4f3-c053a2c0b936 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1143 microversion: 2.1 time: 0.081990 Jul 20 23:09:10.417716 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 607/1221] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:10 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:11.433800 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e395f700-eca8-47d6-83d8-0dd2f3086d7f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:11.434386 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e395f700-eca8-47d6-83d8-0dd2f3086d7f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:11.441858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e395f700-eca8-47d6-83d8-0dd2f3086d7f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:11.442303 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e395f700-eca8-47d6-83d8-0dd2f3086d7f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:11.443081 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e395f700-eca8-47d6-83d8-0dd2f3086d7f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:11.443509 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e395f700-eca8-47d6-83d8-0dd2f3086d7f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:11.525237 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e395f700-eca8-47d6-83d8-0dd2f3086d7f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:11.533611 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e395f700-eca8-47d6-83d8-0dd2f3086d7f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1199 microversion: 2.1 time: 0.103779 Jul 20 23:09:11.534183 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 615/1222] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:11 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1199 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:12.550278 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d3e33e5a-a686-445d-924c-97f5cb50d315 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:12.550881 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d3e33e5a-a686-445d-924c-97f5cb50d315 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:12.557635 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d3e33e5a-a686-445d-924c-97f5cb50d315 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:12.562993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d3e33e5a-a686-445d-924c-97f5cb50d315 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:12.562993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d3e33e5a-a686-445d-924c-97f5cb50d315 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:12.562993 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d3e33e5a-a686-445d-924c-97f5cb50d315 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:12.699441 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d3e33e5a-a686-445d-924c-97f5cb50d315 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:12.706882 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d3e33e5a-a686-445d-924c-97f5cb50d315 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1277 microversion: 2.1 time: 0.160436 Jul 20 23:09:12.712105 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 608/1223] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:12 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:13.427608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-1c268293-4416-4572-8ee8-d70d3753aaba req-c7bd38ab-6a6f-4cd7-b553-a3400c023702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a945790-cfd2-40ca-9846-df71a8f5527f", "tag": "b1677501-043d-4414-b8e5-720801f27b48"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:09:13.439788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-1c268293-4416-4572-8ee8-d70d3753aaba req-c7bd38ab-6a6f-4cd7-b553-a3400c023702 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:13.440576 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-1c268293-4416-4572-8ee8-d70d3753aaba req-c7bd38ab-6a6f-4cd7-b553-a3400c023702 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:13.453497 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-1c268293-4416-4572-8ee8-d70d3753aaba req-c7bd38ab-6a6f-4cd7-b553-a3400c023702 service nova] Creating event network-changed:b1677501-043d-4414-b8e5-720801f27b48 for instance 5a945790-cfd2-40ca-9846-df71a8f5527f on hv-cinder-79987 Jul 20 23:09:13.458348 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-1c268293-4416-4572-8ee8-d70d3753aaba req-c7bd38ab-6a6f-4cd7-b553-a3400c023702 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034660 Jul 20 23:09:13.459345 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 616/1224] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:09:13.724453 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a6cba51e-bd7c-4a11-86f9-f03a3e4e0e63 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:13.725044 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a6cba51e-bd7c-4a11-86f9-f03a3e4e0e63 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:13.732222 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6cba51e-bd7c-4a11-86f9-f03a3e4e0e63 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:13.732706 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6cba51e-bd7c-4a11-86f9-f03a3e4e0e63 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:13.733467 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6cba51e-bd7c-4a11-86f9-f03a3e4e0e63 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:13.734049 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a6cba51e-bd7c-4a11-86f9-f03a3e4e0e63 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:13.866370 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a6cba51e-bd7c-4a11-86f9-f03a3e4e0e63 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:13.874791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a6cba51e-bd7c-4a11-86f9-f03a3e4e0e63 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.154272 Jul 20 23:09:13.875606 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 609/1225] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:13 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:14.893553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f538dba0-4d84-49d7-b211-eac571b71db1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:14.894251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f538dba0-4d84-49d7-b211-eac571b71db1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:14.900442 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f538dba0-4d84-49d7-b211-eac571b71db1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:14.900889 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f538dba0-4d84-49d7-b211-eac571b71db1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:14.901646 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f538dba0-4d84-49d7-b211-eac571b71db1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:14.902080 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f538dba0-4d84-49d7-b211-eac571b71db1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:15.293788 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-f538dba0-4d84-49d7-b211-eac571b71db1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:15.301330 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f538dba0-4d84-49d7-b211-eac571b71db1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.413116 Jul 20 23:09:15.301887 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 617/1226] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:14 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:16.318848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-649822a0-a1bf-47e9-939e-3954f6ca7a02 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:16.320128 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-649822a0-a1bf-47e9-939e-3954f6ca7a02 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:16.327222 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-649822a0-a1bf-47e9-939e-3954f6ca7a02 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:16.327673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-649822a0-a1bf-47e9-939e-3954f6ca7a02 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:16.328433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-649822a0-a1bf-47e9-939e-3954f6ca7a02 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:16.328869 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-649822a0-a1bf-47e9-939e-3954f6ca7a02 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:16.463921 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-649822a0-a1bf-47e9-939e-3954f6ca7a02 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:16.471795 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-649822a0-a1bf-47e9-939e-3954f6ca7a02 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.156801 Jul 20 23:09:16.472359 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 610/1227] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:16 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:17.489029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-1fe0a37d-e632-44a1-9af1-e37b8eb168eb tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:17.489580 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-1fe0a37d-e632-44a1-9af1-e37b8eb168eb tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:17.495967 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1fe0a37d-e632-44a1-9af1-e37b8eb168eb tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:17.497007 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1fe0a37d-e632-44a1-9af1-e37b8eb168eb tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:17.498032 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1fe0a37d-e632-44a1-9af1-e37b8eb168eb tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:17.498463 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-1fe0a37d-e632-44a1-9af1-e37b8eb168eb tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:17.626541 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-1fe0a37d-e632-44a1-9af1-e37b8eb168eb tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:17.633972 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-1fe0a37d-e632-44a1-9af1-e37b8eb168eb tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.148899 Jul 20 23:09:17.634531 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 618/1228] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:17 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:18.650739 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-dcc24db7-258b-4251-a15f-85f7c3263c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:18.651371 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-dcc24db7-258b-4251-a15f-85f7c3263c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:18.657891 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dcc24db7-258b-4251-a15f-85f7c3263c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:18.658331 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dcc24db7-258b-4251-a15f-85f7c3263c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:18.659115 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dcc24db7-258b-4251-a15f-85f7c3263c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:18.659534 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dcc24db7-258b-4251-a15f-85f7c3263c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:18.704880 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:09:18.730319 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=6 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:09:18.790042 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-dcc24db7-258b-4251-a15f-85f7c3263c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:18.798157 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-dcc24db7-258b-4251-a15f-85f7c3263c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.151252 Jul 20 23:09:18.798723 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 611/1229] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:18 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 23:09:19.814807 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-455e67f2-d735-45dc-a426-c28d36874380 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:19.815560 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-455e67f2-d735-45dc-a426-c28d36874380 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:19.817927 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:09:19.822774 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-455e67f2-d735-45dc-a426-c28d36874380 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:19.823261 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-455e67f2-d735-45dc-a426-c28d36874380 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:19.824022 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-455e67f2-d735-45dc-a426-c28d36874380 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:19.824453 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-455e67f2-d735-45dc-a426-c28d36874380 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:19.961634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-455e67f2-d735-45dc-a426-c28d36874380 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:19.968983 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-455e67f2-d735-45dc-a426-c28d36874380 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.158074 Jul 20 23:09:19.969546 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 619/1230] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:19 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:20.985732 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8144082d-5d8c-4eb0-8641-73acd568f0cc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:20.986301 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8144082d-5d8c-4eb0-8641-73acd568f0cc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:20.992705 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8144082d-5d8c-4eb0-8641-73acd568f0cc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:20.993142 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8144082d-5d8c-4eb0-8641-73acd568f0cc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:20.993885 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8144082d-5d8c-4eb0-8641-73acd568f0cc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:20.994337 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8144082d-5d8c-4eb0-8641-73acd568f0cc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:21.126968 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-8144082d-5d8c-4eb0-8641-73acd568f0cc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:21.134477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8144082d-5d8c-4eb0-8641-73acd568f0cc tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.152753 Jul 20 23:09:21.135059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 612/1231] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:20 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:22.151679 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-180e8438-6d8e-457d-b1ae-c20f1c6e3ed1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:22.152302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-180e8438-6d8e-457d-b1ae-c20f1c6e3ed1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:22.159274 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-180e8438-6d8e-457d-b1ae-c20f1c6e3ed1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:22.159712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-180e8438-6d8e-457d-b1ae-c20f1c6e3ed1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:22.160456 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-180e8438-6d8e-457d-b1ae-c20f1c6e3ed1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:22.160878 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-180e8438-6d8e-457d-b1ae-c20f1c6e3ed1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:22.291002 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-180e8438-6d8e-457d-b1ae-c20f1c6e3ed1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:22.305649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-180e8438-6d8e-457d-b1ae-c20f1c6e3ed1 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.151679 Jul 20 23:09:22.305649 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 620/1232] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:22 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:23.316803 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9ec6eb54-8c9b-4ca6-adce-ac1a5be3b68e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:23.317414 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9ec6eb54-8c9b-4ca6-adce-ac1a5be3b68e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:23.323963 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9ec6eb54-8c9b-4ca6-adce-ac1a5be3b68e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:23.324410 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9ec6eb54-8c9b-4ca6-adce-ac1a5be3b68e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:23.325171 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9ec6eb54-8c9b-4ca6-adce-ac1a5be3b68e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:23.325608 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9ec6eb54-8c9b-4ca6-adce-ac1a5be3b68e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:23.453568 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9ec6eb54-8c9b-4ca6-adce-ac1a5be3b68e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:23.460912 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9ec6eb54-8c9b-4ca6-adce-ac1a5be3b68e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.148531 Jul 20 23:09:23.461470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 613/1233] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:23 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:24.477757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e849368d-3070-4ad9-a5f5-74c5ab0f881c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:24.478304 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e849368d-3070-4ad9-a5f5-74c5ab0f881c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:24.484840 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e849368d-3070-4ad9-a5f5-74c5ab0f881c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:24.485286 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e849368d-3070-4ad9-a5f5-74c5ab0f881c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:24.486102 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e849368d-3070-4ad9-a5f5-74c5ab0f881c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:24.486538 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e849368d-3070-4ad9-a5f5-74c5ab0f881c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:24.623416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e849368d-3070-4ad9-a5f5-74c5ab0f881c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:24.631455 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e849368d-3070-4ad9-a5f5-74c5ab0f881c tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.157474 Jul 20 23:09:24.632035 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 621/1234] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:24 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:24.638038 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-767b58df-247f-479b-b013-41d0eb65f3d6 req-6ca7f8aa-1d85-4a1e-bb88-f3d2fb495825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a945790-cfd2-40ca-9846-df71a8f5527f", "name": "network-vif-plugged", "status": "completed", "tag": "b1677501-043d-4414-b8e5-720801f27b48"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:09:24.647241 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-767b58df-247f-479b-b013-41d0eb65f3d6 req-6ca7f8aa-1d85-4a1e-bb88-f3d2fb495825 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:24.648742 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-767b58df-247f-479b-b013-41d0eb65f3d6 req-6ca7f8aa-1d85-4a1e-bb88-f3d2fb495825 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:24.658473 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-767b58df-247f-479b-b013-41d0eb65f3d6 req-6ca7f8aa-1d85-4a1e-bb88-f3d2fb495825 service nova] Creating event network-vif-plugged:b1677501-043d-4414-b8e5-720801f27b48 for instance 5a945790-cfd2-40ca-9846-df71a8f5527f on hv-cinder-79987 Jul 20 23:09:24.663531 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-767b58df-247f-479b-b013-41d0eb65f3d6 req-6ca7f8aa-1d85-4a1e-bb88-f3d2fb495825 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029076 Jul 20 23:09:24.664113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 614/1235] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 23:09:25.648730 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-973a308c-acc9-4a61-92e3-db9b573be055 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:25.649323 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-973a308c-acc9-4a61-92e3-db9b573be055 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:25.655757 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-973a308c-acc9-4a61-92e3-db9b573be055 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:25.656200 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-973a308c-acc9-4a61-92e3-db9b573be055 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:25.656944 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-973a308c-acc9-4a61-92e3-db9b573be055 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:25.657370 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-973a308c-acc9-4a61-92e3-db9b573be055 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:25.789477 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-973a308c-acc9-4a61-92e3-db9b573be055 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:25.796911 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-973a308c-acc9-4a61-92e3-db9b573be055 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.152060 Jul 20 23:09:25.797467 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 622/1236] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:25 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:26.815781 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c2e24d1b-5451-46fc-a8a6-6d40cb524708 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:26.816477 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c2e24d1b-5451-46fc-a8a6-6d40cb524708 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:26.822718 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2e24d1b-5451-46fc-a8a6-6d40cb524708 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:26.823203 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2e24d1b-5451-46fc-a8a6-6d40cb524708 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:26.824017 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2e24d1b-5451-46fc-a8a6-6d40cb524708 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:26.824455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c2e24d1b-5451-46fc-a8a6-6d40cb524708 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:26.954924 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c2e24d1b-5451-46fc-a8a6-6d40cb524708 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:26.962447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c2e24d1b-5451-46fc-a8a6-6d40cb524708 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1265 microversion: 2.1 time: 0.152345 Jul 20 23:09:26.963028 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 615/1237] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:26 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:27.979608 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8e2e8428-f97e-456a-a55c-1a249cfba9b7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:27.980210 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8e2e8428-f97e-456a-a55c-1a249cfba9b7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:27.986604 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8e2e8428-f97e-456a-a55c-1a249cfba9b7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:27.987677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8e2e8428-f97e-456a-a55c-1a249cfba9b7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:27.988528 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8e2e8428-f97e-456a-a55c-1a249cfba9b7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:27.988956 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8e2e8428-f97e-456a-a55c-1a249cfba9b7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:28.117399 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8e2e8428-f97e-456a-a55c-1a249cfba9b7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:28.125004 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8e2e8428-f97e-456a-a55c-1a249cfba9b7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1453 microversion: 2.1 time: 0.149270 Jul 20 23:09:28.125565 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 623/1238] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:27 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:28.140701 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-d83d85c4-b4c4-4bd3-b21a-d3d825680c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:09:28.141315 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-d83d85c4-b4c4-4bd3-b21a-d3d825680c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:09:28.148265 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d83d85c4-b4c4-4bd3-b21a-d3d825680c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:28.148714 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d83d85c4-b4c4-4bd3-b21a-d3d825680c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:28.149471 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d83d85c4-b4c4-4bd3-b21a-d3d825680c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:28.149905 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-d83d85c4-b4c4-4bd3-b21a-d3d825680c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:28.283001 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-d83d85c4-b4c4-4bd3-b21a-d3d825680c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:09:28.291256 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-d83d85c4-b4c4-4bd3-b21a-d3d825680c1f tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1453 microversion: 2.1 time: 0.154343 Jul 20 23:09:28.291816 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 616/1239] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:09:28 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:09:30.553620 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-f0f807d3-34c2-4d52-96f1-271e173b1fca req-a7152178-1c2e-4656-a8d0-964d2e6a0830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a945790-cfd2-40ca-9846-df71a8f5527f", "tag": "b1677501-043d-4414-b8e5-720801f27b48"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:09:30.561627 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-f0f807d3-34c2-4d52-96f1-271e173b1fca req-a7152178-1c2e-4656-a8d0-964d2e6a0830 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:09:30.562073 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-f0f807d3-34c2-4d52-96f1-271e173b1fca req-a7152178-1c2e-4656-a8d0-964d2e6a0830 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:09:30.574144 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-f0f807d3-34c2-4d52-96f1-271e173b1fca req-a7152178-1c2e-4656-a8d0-964d2e6a0830 service nova] Creating event network-changed:b1677501-043d-4414-b8e5-720801f27b48 for instance 5a945790-cfd2-40ca-9846-df71a8f5527f on hv-cinder-79987 Jul 20 23:09:30.579833 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-f0f807d3-34c2-4d52-96f1-271e173b1fca req-a7152178-1c2e-4656-a8d0-964d2e6a0830 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085869 Jul 20 23:09:30.580434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 624/1240] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:11:28.526837 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:11:28.532496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=78 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:11:28.532496 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-712213466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-648746233", "security_groups": [{"name": "tempest-secgroup-smoke-1006332140"}], "block_device_mapping_v2": [{"uuid": "8ff039a4-cac4-4f16-ab78-b036049d37dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "393bfb36-cc5b-4cce-9cdb-4858c0a973cc"}]}} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:11:28.695483 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.network.neutron [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] validate_networks() for [('393bfb36-cc5b-4cce-9cdb-4858c0a973cc', None, None, None, None, None)] {{(pid=124912) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 23:11:29.071909 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Flavor limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 23:11:29.072329 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Image limits 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 23:11:29.072822 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Flavor pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 23:11:29.073251 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Image pref 0:0:0 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 23:11:29.073654 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.virt.hardware [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124912) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 23:11:29.082455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:29.082894 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:29.083706 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:29.084135 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:29.100393 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Getting quotas for project 9044845bc9d34e1e8794a43dda688527. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 23:11:29.104286 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.quota [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Getting quotas for user 13390807045f4acdbbe4ea77af4dbb52 and project 9044845bc9d34e1e8794a43dda688527. Resources: {'ram', 'cores', 'instances'} {{(pid=124912) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 23:11:29.160038 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Going to run 1 instances... {{(pid=124912) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 23:11:29.162126 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ff039a4-cac4-4f16-ab78-b036049d37dd',volume_size=None,volume_type=None)] {{(pid=124912) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 23:11:29.550263 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-b5ce3db4-bf4d-42fb-b308-deae1f63f5c5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025122 Jul 20 23:11:29.550983 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 617/1241] 10.222.0.81 () {60 vars in 1146 bytes} [Wed Jul 20 23:11:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 23:11:29.569109 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-9f745acd-3788-47b3-9332-ce448cea73ad tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:29.570331 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-9f745acd-3788-47b3-9332-ce448cea73ad tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:29.575103 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c2e4b22b-8bc9-4257-b729-f54407974796] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 23:11:29.576958 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:11:29.578137 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:11:29.690262 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-9f745acd-3788-47b3-9332-ce448cea73ad tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:29.697623 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-9f745acd-3788-47b3-9332-ce448cea73ad tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1093 microversion: 2.1 time: 0.136792 Jul 20 23:11:29.698180 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 625/1242] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:29 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1093 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:30.715687 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-cb342f82-2e26-4461-8f78-268ec184df15 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:30.716979 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-cb342f82-2e26-4461-8f78-268ec184df15 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:30.722631 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb342f82-2e26-4461-8f78-268ec184df15 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:30.723113 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb342f82-2e26-4461-8f78-268ec184df15 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:30.723888 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb342f82-2e26-4461-8f78-268ec184df15 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:30.724333 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-cb342f82-2e26-4461-8f78-268ec184df15 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:30.785728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-cb342f82-2e26-4461-8f78-268ec184df15 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:30.793935 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-cb342f82-2e26-4461-8f78-268ec184df15 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1135 microversion: 2.1 time: 0.083149 Jul 20 23:11:30.794489 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 618/1243] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:30 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1135 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:31.810571 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-fcf58e6f-5fe6-4e53-b8da-ea6924f32104 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:31.811276 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-fcf58e6f-5fe6-4e53-b8da-ea6924f32104 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:31.822110 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fcf58e6f-5fe6-4e53-b8da-ea6924f32104 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:31.822553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fcf58e6f-5fe6-4e53-b8da-ea6924f32104 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:31.823349 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fcf58e6f-5fe6-4e53-b8da-ea6924f32104 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:31.823812 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-fcf58e6f-5fe6-4e53-b8da-ea6924f32104 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:31.829448 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] [c2e4b22b-8bc9-4257-b729-f54407974796] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 48834. Jul 20 23:11:31.902284 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-fcf58e6f-5fe6-4e53-b8da-ea6924f32104 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:31.909672 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-fcf58e6f-5fe6-4e53-b8da-ea6924f32104 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1209 microversion: 2.1 time: 0.103467 Jul 20 23:11:31.910238 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 626/1244] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:31 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:32.926506 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-55815eb8-d5a9-4a43-b3f0-7aa8c74d1943 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:32.927224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-55815eb8-d5a9-4a43-b3f0-7aa8c74d1943 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:32.939328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-55815eb8-d5a9-4a43-b3f0-7aa8c74d1943 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:32.939328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-55815eb8-d5a9-4a43-b3f0-7aa8c74d1943 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:32.939328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-55815eb8-d5a9-4a43-b3f0-7aa8c74d1943 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:32.939328 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-55815eb8-d5a9-4a43-b3f0-7aa8c74d1943 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:33.078789 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-55815eb8-d5a9-4a43-b3f0-7aa8c74d1943 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:33.086661 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-55815eb8-d5a9-4a43-b3f0-7aa8c74d1943 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1277 microversion: 2.1 time: 0.164114 Jul 20 23:11:33.087470 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 619/1245] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:32 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:33.227736 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-45364102-f443-4d1c-b9f6-695d46bab9b2 req-13276f3d-006e-4b15-b735-2dffadea7ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89769578-84e8-43e2-b93b-49ded0950410", "tag": "282d02a3-1441-4a69-a69c-a9f60f1824f0"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:11:33.243712 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-45364102-f443-4d1c-b9f6-695d46bab9b2 req-13276f3d-006e-4b15-b735-2dffadea7ced service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:33.244353 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-45364102-f443-4d1c-b9f6-695d46bab9b2 req-13276f3d-006e-4b15-b735-2dffadea7ced service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:33.257432 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-45364102-f443-4d1c-b9f6-695d46bab9b2 req-13276f3d-006e-4b15-b735-2dffadea7ced service nova] Creating event network-changed:282d02a3-1441-4a69-a69c-a9f60f1824f0 for instance 89769578-84e8-43e2-b93b-49ded0950410 on hv-cinder-79987 Jul 20 23:11:33.262681 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-45364102-f443-4d1c-b9f6-695d46bab9b2 req-13276f3d-006e-4b15-b735-2dffadea7ced service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040278 Jul 20 23:11:33.263573 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 627/1246] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:11:34.103211 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c4b62da4-0658-4863-abc3-a830f80cf7c4 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:34.103842 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c4b62da4-0658-4863-abc3-a830f80cf7c4 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:34.110215 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c4b62da4-0658-4863-abc3-a830f80cf7c4 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:34.110659 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c4b62da4-0658-4863-abc3-a830f80cf7c4 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:34.111543 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c4b62da4-0658-4863-abc3-a830f80cf7c4 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:34.111878 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c4b62da4-0658-4863-abc3-a830f80cf7c4 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:34.244906 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-c4b62da4-0658-4863-abc3-a830f80cf7c4 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:34.252775 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c4b62da4-0658-4863-abc3-a830f80cf7c4 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.153490 Jul 20 23:11:34.253360 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 620/1247] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:34 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:35.272376 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-aabf65bf-ae26-4038-86bc-abc4f600df59 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:35.273086 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-aabf65bf-ae26-4038-86bc-abc4f600df59 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:35.281093 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aabf65bf-ae26-4038-86bc-abc4f600df59 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:35.281756 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aabf65bf-ae26-4038-86bc-abc4f600df59 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:35.282527 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aabf65bf-ae26-4038-86bc-abc4f600df59 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:35.282958 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-aabf65bf-ae26-4038-86bc-abc4f600df59 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:35.420028 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-aabf65bf-ae26-4038-86bc-abc4f600df59 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:35.427368 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-aabf65bf-ae26-4038-86bc-abc4f600df59 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.160777 Jul 20 23:11:35.427920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 628/1248] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:35 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:36.444899 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-085e40c1-dd98-4907-b151-455e1c639900 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:36.445567 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-085e40c1-dd98-4907-b151-455e1c639900 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:36.451757 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-085e40c1-dd98-4907-b151-455e1c639900 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:36.452203 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-085e40c1-dd98-4907-b151-455e1c639900 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:36.452958 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-085e40c1-dd98-4907-b151-455e1c639900 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:36.453393 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-085e40c1-dd98-4907-b151-455e1c639900 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:36.582948 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-085e40c1-dd98-4907-b151-455e1c639900 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:36.590916 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-085e40c1-dd98-4907-b151-455e1c639900 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.150126 Jul 20 23:11:36.591531 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 621/1249] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:36 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:37.607523 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-38101f23-7cbe-4be3-8946-82f9198cf377 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:37.608123 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-38101f23-7cbe-4be3-8946-82f9198cf377 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:37.614456 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-38101f23-7cbe-4be3-8946-82f9198cf377 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:37.614898 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-38101f23-7cbe-4be3-8946-82f9198cf377 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:37.615677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-38101f23-7cbe-4be3-8946-82f9198cf377 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:37.616104 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-38101f23-7cbe-4be3-8946-82f9198cf377 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:37.743574 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-38101f23-7cbe-4be3-8946-82f9198cf377 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:37.751686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-38101f23-7cbe-4be3-8946-82f9198cf377 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.148001 Jul 20 23:11:37.752251 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 629/1250] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:37 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:38.768688 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-9a73559b-e040-4181-89a4-10a7dcb3aa94 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:38.769212 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-9a73559b-e040-4181-89a4-10a7dcb3aa94 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:38.776123 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9a73559b-e040-4181-89a4-10a7dcb3aa94 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:38.776561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9a73559b-e040-4181-89a4-10a7dcb3aa94 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:38.777301 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9a73559b-e040-4181-89a4-10a7dcb3aa94 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:38.777728 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-9a73559b-e040-4181-89a4-10a7dcb3aa94 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:38.910131 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-9a73559b-e040-4181-89a4-10a7dcb3aa94 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:38.918340 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-9a73559b-e040-4181-89a4-10a7dcb3aa94 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.154056 Jul 20 23:11:38.918903 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 622/1251] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:38 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:39.939634 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-a51db481-c6a8-4832-ab8c-e684fecf7360 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:39.940246 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-a51db481-c6a8-4832-ab8c-e684fecf7360 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:39.942666 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell0:SELECT=2 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:11:39.948025 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a51db481-c6a8-4832-ab8c-e684fecf7360 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:39.948472 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a51db481-c6a8-4832-ab8c-e684fecf7360 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:39.949229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a51db481-c6a8-4832-ab8c-e684fecf7360 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:39.949659 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-a51db481-c6a8-4832-ab8c-e684fecf7360 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:40.082503 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-a51db481-c6a8-4832-ab8c-e684fecf7360 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:40.090496 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-a51db481-c6a8-4832-ab8c-e684fecf7360 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.154677 Jul 20 23:11:40.091073 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 630/1252] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:39 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:41.106765 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-ecd1a538-b707-46cb-8c4d-218a0a29a6c3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:41.107396 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-ecd1a538-b707-46cb-8c4d-218a0a29a6c3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:41.109240 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=2 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:11:41.109910 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell0:SELECT=6 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:11:41.115242 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ecd1a538-b707-46cb-8c4d-218a0a29a6c3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:41.115695 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ecd1a538-b707-46cb-8c4d-218a0a29a6c3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:41.120411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ecd1a538-b707-46cb-8c4d-218a0a29a6c3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:41.120411 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-ecd1a538-b707-46cb-8c4d-218a0a29a6c3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:41.248010 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-ecd1a538-b707-46cb-8c4d-218a0a29a6c3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:41.255519 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-ecd1a538-b707-46cb-8c4d-218a0a29a6c3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.152515 Jul 20 23:11:41.256091 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 623/1253] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:41 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:42.272742 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-e4e9edd4-903d-4118-bf8e-d0d1297475ab tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:42.273375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-e4e9edd4-903d-4118-bf8e-d0d1297475ab tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:42.280281 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4e9edd4-903d-4118-bf8e-d0d1297475ab tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:42.280729 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4e9edd4-903d-4118-bf8e-d0d1297475ab tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:42.281553 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4e9edd4-903d-4118-bf8e-d0d1297475ab tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:42.281985 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-e4e9edd4-903d-4118-bf8e-d0d1297475ab tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:42.410027 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-e4e9edd4-903d-4118-bf8e-d0d1297475ab tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:42.418196 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-e4e9edd4-903d-4118-bf8e-d0d1297475ab tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.149254 Jul 20 23:11:42.418778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 631/1254] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:42 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:43.434584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-1fdc284a-9c12-4d31-b52e-17f2862ae602 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:43.435297 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-1fdc284a-9c12-4d31-b52e-17f2862ae602 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:43.441798 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1fdc284a-9c12-4d31-b52e-17f2862ae602 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:43.442255 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1fdc284a-9c12-4d31-b52e-17f2862ae602 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:43.443027 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1fdc284a-9c12-4d31-b52e-17f2862ae602 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:43.443480 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-1fdc284a-9c12-4d31-b52e-17f2862ae602 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:43.573447 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-1fdc284a-9c12-4d31-b52e-17f2862ae602 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:43.581132 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-1fdc284a-9c12-4d31-b52e-17f2862ae602 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.150330 Jul 20 23:11:43.581710 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 624/1255] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:43 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:44.597518 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-663de9ec-69ab-4b69-a082-9e64ca959ec9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:44.598128 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-663de9ec-69ab-4b69-a082-9e64ca959ec9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:44.605003 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-663de9ec-69ab-4b69-a082-9e64ca959ec9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:44.605451 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-663de9ec-69ab-4b69-a082-9e64ca959ec9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:44.606327 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-663de9ec-69ab-4b69-a082-9e64ca959ec9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:44.606767 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-663de9ec-69ab-4b69-a082-9e64ca959ec9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:44.743690 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-663de9ec-69ab-4b69-a082-9e64ca959ec9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:44.751064 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-663de9ec-69ab-4b69-a082-9e64ca959ec9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.157351 Jul 20 23:11:44.751630 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 632/1256] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:44 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:45.357681 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-c9557917-3f44-48fe-9a31-7f2390850ba8 req-13935323-48d6-40ef-92bf-480e2bf62c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89769578-84e8-43e2-b93b-49ded0950410", "name": "network-vif-plugged", "status": "completed", "tag": "282d02a3-1441-4a69-a69c-a9f60f1824f0"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:11:45.365597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c9557917-3f44-48fe-9a31-7f2390850ba8 req-13935323-48d6-40ef-92bf-480e2bf62c75 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:45.366036 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-c9557917-3f44-48fe-9a31-7f2390850ba8 req-13935323-48d6-40ef-92bf-480e2bf62c75 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:45.377559 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-c9557917-3f44-48fe-9a31-7f2390850ba8 req-13935323-48d6-40ef-92bf-480e2bf62c75 service nova] Creating event network-vif-plugged:282d02a3-1441-4a69-a69c-a9f60f1824f0 for instance 89769578-84e8-43e2-b93b-49ded0950410 on hv-cinder-79987 Jul 20 23:11:45.382634 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-c9557917-3f44-48fe-9a31-7f2390850ba8 req-13935323-48d6-40ef-92bf-480e2bf62c75 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077965 Jul 20 23:11:45.383322 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 625/1257] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:11:45.768823 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-0cfea4b2-6a15-49fe-924c-9aed2ac303c0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:45.769406 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-0cfea4b2-6a15-49fe-924c-9aed2ac303c0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:45.776372 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0cfea4b2-6a15-49fe-924c-9aed2ac303c0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:45.776816 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0cfea4b2-6a15-49fe-924c-9aed2ac303c0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:45.777709 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0cfea4b2-6a15-49fe-924c-9aed2ac303c0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:45.778229 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-0cfea4b2-6a15-49fe-924c-9aed2ac303c0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:45.949021 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-0cfea4b2-6a15-49fe-924c-9aed2ac303c0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:45.957481 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-0cfea4b2-6a15-49fe-924c-9aed2ac303c0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.193449 Jul 20 23:11:45.958094 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 633/1258] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:45 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:46.977158 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-a0ec2142-b546-4d1b-94a7-f8c843172d57 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:46.977877 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-a0ec2142-b546-4d1b-94a7-f8c843172d57 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:46.984147 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a0ec2142-b546-4d1b-94a7-f8c843172d57 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:46.984589 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a0ec2142-b546-4d1b-94a7-f8c843172d57 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:46.985344 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a0ec2142-b546-4d1b-94a7-f8c843172d57 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:46.985778 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-a0ec2142-b546-4d1b-94a7-f8c843172d57 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:47.123936 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-a0ec2142-b546-4d1b-94a7-f8c843172d57 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:47.131370 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-a0ec2142-b546-4d1b-94a7-f8c843172d57 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1265 microversion: 2.1 time: 0.158868 Jul 20 23:11:47.131933 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 626/1259] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:46 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:48.149203 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-25898121-0258-4512-9fa3-064fbe132657 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:48.149858 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-25898121-0258-4512-9fa3-064fbe132657 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:48.156402 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-25898121-0258-4512-9fa3-064fbe132657 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:48.156850 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-25898121-0258-4512-9fa3-064fbe132657 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:48.157621 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-25898121-0258-4512-9fa3-064fbe132657 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:48.158054 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-25898121-0258-4512-9fa3-064fbe132657 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:48.386494 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-25898121-0258-4512-9fa3-064fbe132657 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:48.394549 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-25898121-0258-4512-9fa3-064fbe132657 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1453 microversion: 2.1 time: 0.249721 Jul 20 23:11:48.395236 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 634/1260] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:48 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:48.411068 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-05b361fa-ceda-48eb-bfbb-f14e26cb2401 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:11:48.411685 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-05b361fa-ceda-48eb-bfbb-f14e26cb2401 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:11:48.418330 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-05b361fa-ceda-48eb-bfbb-f14e26cb2401 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:48.418777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-05b361fa-ceda-48eb-bfbb-f14e26cb2401 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:48.419591 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-05b361fa-ceda-48eb-bfbb-f14e26cb2401 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:48.420035 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-05b361fa-ceda-48eb-bfbb-f14e26cb2401 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:48.550051 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-05b361fa-ceda-48eb-bfbb-f14e26cb2401 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:11:48.558155 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-05b361fa-ceda-48eb-bfbb-f14e26cb2401 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1453 microversion: 2.1 time: 0.150982 Jul 20 23:11:48.558722 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 627/1261] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:11:48 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:11:50.532677 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-4220ff02-f7a9-40e0-994a-8cc5943cef27 req-ded51b15-ddea-430d-8196-3f86f44a4b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89769578-84e8-43e2-b93b-49ded0950410", "tag": "282d02a3-1441-4a69-a69c-a9f60f1824f0"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:11:50.541361 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-4220ff02-f7a9-40e0-994a-8cc5943cef27 req-ded51b15-ddea-430d-8196-3f86f44a4b22 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:11:50.541903 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-4220ff02-f7a9-40e0-994a-8cc5943cef27 req-ded51b15-ddea-430d-8196-3f86f44a4b22 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:11:50.553230 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-4220ff02-f7a9-40e0-994a-8cc5943cef27 req-ded51b15-ddea-430d-8196-3f86f44a4b22 service nova] Creating event network-changed:282d02a3-1441-4a69-a69c-a9f60f1824f0 for instance 89769578-84e8-43e2-b93b-49ded0950410 on hv-cinder-79987 Jul 20 23:11:50.558473 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-4220ff02-f7a9-40e0-994a-8cc5943cef27 req-ded51b15-ddea-430d-8196-3f86f44a4b22 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029519 Jul 20 23:11:50.559434 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 635/1262] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:12:14.826017 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:12:14.826697 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:12:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:12:21.267316 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:12:21.268173 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:12:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:12:21.416224 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:12:21.416791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:12:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:13:42.594176 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:13:42.595414 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG dbcounter [-] [124912] Writing DB stats nova_cell1:SELECT=58 {{(pid=124912) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:13:42.600052 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_api:SELECT=24 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:13:42.607101 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG dbcounter [-] [124913] Writing DB stats nova_cell1:SELECT=52 {{(pid=124913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:13:42.607234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-8e10fa40-7fee-49a7-a6d6-972d836ad6e0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:42.607234 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8e10fa40-7fee-49a7-a6d6-972d836ad6e0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:42.607407 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-cd3e826b-5133-438a-a5fd-2e7b8105b6e8 req-4a6984cd-cbac-4c8c-b327-4ffb1efc27e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89769578-84e8-43e2-b93b-49ded0950410", "tag": "282d02a3-1441-4a69-a69c-a9f60f1824f0"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:13:42.608584 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e10fa40-7fee-49a7-a6d6-972d836ad6e0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:42.609007 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e10fa40-7fee-49a7-a6d6-972d836ad6e0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:42.609890 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e10fa40-7fee-49a7-a6d6-972d836ad6e0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:42.610225 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-8e10fa40-7fee-49a7-a6d6-972d836ad6e0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:42.613826 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-cd3e826b-5133-438a-a5fd-2e7b8105b6e8 req-4a6984cd-cbac-4c8c-b327-4ffb1efc27e3 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:42.614257 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-cd3e826b-5133-438a-a5fd-2e7b8105b6e8 req-4a6984cd-cbac-4c8c-b327-4ffb1efc27e3 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:42.626066 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-cd3e826b-5133-438a-a5fd-2e7b8105b6e8 req-4a6984cd-cbac-4c8c-b327-4ffb1efc27e3 service nova] Creating event network-changed:282d02a3-1441-4a69-a69c-a9f60f1824f0 for instance 89769578-84e8-43e2-b93b-49ded0950410 on hv-cinder-79987 Jul 20 23:13:42.632637 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-cd3e826b-5133-438a-a5fd-2e7b8105b6e8 req-4a6984cd-cbac-4c8c-b327-4ffb1efc27e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034143 Jul 20 23:13:42.633744 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 636/1263] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:13:42.637501 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-8e10fa40-7fee-49a7-a6d6-972d836ad6e0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 23:13:42.924286 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-8e10fa40-7fee-49a7-a6d6-972d836ad6e0 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 204 len: 0 microversion: 2.1 time: 0.331804 Jul 20 23:13:42.924884 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 628/1264] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 23:13:42 2022] DELETE /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 23:13:42.934759 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-8f47fea4-6522-42f8-97fb-02f7c7b4c5f5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:42.935469 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-8f47fea4-6522-42f8-97fb-02f7c7b4c5f5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:42.943816 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8f47fea4-6522-42f8-97fb-02f7c7b4c5f5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:42.944263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8f47fea4-6522-42f8-97fb-02f7c7b4c5f5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:42.945029 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8f47fea4-6522-42f8-97fb-02f7c7b4c5f5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:42.945463 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-8f47fea4-6522-42f8-97fb-02f7c7b4c5f5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:43.076709 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-8f47fea4-6522-42f8-97fb-02f7c7b4c5f5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:13:43.084263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-8f47fea4-6522-42f8-97fb-02f7c7b4c5f5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1578 microversion: 2.1 time: 0.154362 Jul 20 23:13:43.084820 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 637/1265] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:42 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 23:13:44.104001 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2beeccfd-cc5a-4af8-a683-a239081dc37b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:44.104699 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2beeccfd-cc5a-4af8-a683-a239081dc37b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:44.111339 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2beeccfd-cc5a-4af8-a683-a239081dc37b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:44.111800 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2beeccfd-cc5a-4af8-a683-a239081dc37b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:44.112561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2beeccfd-cc5a-4af8-a683-a239081dc37b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:44.113879 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2beeccfd-cc5a-4af8-a683-a239081dc37b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:44.250564 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2beeccfd-cc5a-4af8-a683-a239081dc37b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:13:44.257464 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2beeccfd-cc5a-4af8-a683-a239081dc37b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1578 microversion: 2.1 time: 0.157640 Jul 20 23:13:44.258252 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 629/1266] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:44 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:13:45.276190 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-6a4e5749-e3d4-495c-98a6-86b47ae6f8ec tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:45.280785 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-6a4e5749-e3d4-495c-98a6-86b47ae6f8ec tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:45.283773 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a4e5749-e3d4-495c-98a6-86b47ae6f8ec tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:45.284225 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a4e5749-e3d4-495c-98a6-86b47ae6f8ec tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:45.285612 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a4e5749-e3d4-495c-98a6-86b47ae6f8ec tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:45.286041 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-6a4e5749-e3d4-495c-98a6-86b47ae6f8ec tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:45.317980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [req-42d72b4b-6b13-43c1-9356-808764640caa req-a3d45cf9-dd2e-47bd-89a5-b1489a6f5743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89769578-84e8-43e2-b93b-49ded0950410", "name": "network-vif-deleted", "tag": "282d02a3-1441-4a69-a69c-a9f60f1824f0"}]} {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:13:45.330104 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-42d72b4b-6b13-43c1-9356-808764640caa req-a3d45cf9-dd2e-47bd-89a5-b1489a6f5743 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:45.330542 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [req-42d72b4b-6b13-43c1-9356-808764640caa req-a3d45cf9-dd2e-47bd-89a5-b1489a6f5743 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:45.342195 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.compute.server_external_events [req-42d72b4b-6b13-43c1-9356-808764640caa req-a3d45cf9-dd2e-47bd-89a5-b1489a6f5743 service nova] Creating event network-vif-deleted:282d02a3-1441-4a69-a69c-a9f60f1824f0 for instance 89769578-84e8-43e2-b93b-49ded0950410 on hv-cinder-79987 Jul 20 23:13:45.347848 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [req-42d72b4b-6b13-43c1-9356-808764640caa req-a3d45cf9-dd2e-47bd-89a5-b1489a6f5743 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032948 Jul 20 23:13:45.348430 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 630/1267] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:13:45.356116 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-6a4e5749-e3d4-495c-98a6-86b47ae6f8ec tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:13:45.364165 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-6a4e5749-e3d4-495c-98a6-86b47ae6f8ec tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1391 microversion: 2.1 time: 0.091886 Jul 20 23:13:45.364718 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 638/1268] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:45 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1391 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 23:13:46.382662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:46.383393 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:46.389561 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:46.389995 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:46.390764 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:46.391229 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:46.423649 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:46.424085 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:46.424524 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.objects.instance [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lazy-loading 'fault' on Instance uuid 89769578-84e8-43e2-b93b-49ded0950410 {{(pid=124912) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 23:13:46.466657 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:13:46.474061 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-2940555e-f3db-413b-8847-37fd58f05a60 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 200 len: 1229 microversion: 2.1 time: 0.096664 Jul 20 23:13:46.474629 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 631/1269] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:46 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:13:47.491838 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:47.492416 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 89769578-84e8-43e2-b93b-49ded0950410] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:47.498797 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:47.499271 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:47.500025 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:47.500530 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:47.514026 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] HTTP exception thrown: Instance 89769578-84e8-43e2-b93b-49ded0950410 could not be found. Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Request method failure captured: Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 HTTP/1.1 Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IpTjISVBLuMwzxzq_uhOBtFwC0daWVO11LfDtIkBLweKxqWyh3Kt6IQFrjNnhCWlaN7JFYahQs1BdPn6uDgK3SbUMAq7Au9Usja-UWa0DxOAEHWB6GaS75iKYLYPNKEtP9jv2VrMGYkmy2xvFMr80ieizJgz_eGevMFc0FZtAjKcvU Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 23:13:47.515674 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9044845bc9d34e1e8794a43dda688527", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 13390807045f4acdbbe4ea77af4dbb52 Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 89769578-84e8-43e2-b93b-49ded0950410 could not be found. Jul 20 23:13:47.517471 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '89769578-84e8-43e2-b93b-49ded0950410'} Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89769578-84e8-43e2-b93b-49ded0950410 could not be found. Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:13:47.518461 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89769578-84e8-43e2-b93b-49ded0950410 could not be found. Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89769578-84e8-43e2-b93b-49ded0950410 could not be found. Jul 20 23:13:47.520302 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:47.522074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Returning 404 to user: Instance 89769578-84e8-43e2-b93b-49ded0950410 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:13:47.522074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-f4885996-2657-4ce5-bb0c-a50b55a79398 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410" status: 404 len: 111 microversion: 2.1 time: 0.029791 Jul 20 23:13:47.522074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 639/1270] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:47 2022] GET /compute/v2.1/servers/89769578-84e8-43e2-b93b-49ded0950410 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 23:13:50.873116 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-dc432248-8176-4b44-843f-fe53322ba7e3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:50.873662 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-dc432248-8176-4b44-843f-fe53322ba7e3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:50.874813 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-18ca50c3-35d5-450a-9857-9956396272de req-998d3611-6d9d-407f-8abd-8f7c9135b279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a945790-cfd2-40ca-9846-df71a8f5527f", "tag": "b1677501-043d-4414-b8e5-720801f27b48"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:13:50.881831 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc432248-8176-4b44-843f-fe53322ba7e3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:50.883249 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc432248-8176-4b44-843f-fe53322ba7e3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:50.883922 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-18ca50c3-35d5-450a-9857-9956396272de req-998d3611-6d9d-407f-8abd-8f7c9135b279 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:50.884082 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc432248-8176-4b44-843f-fe53322ba7e3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:50.884472 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-dc432248-8176-4b44-843f-fe53322ba7e3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:50.884601 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-18ca50c3-35d5-450a-9857-9956396272de req-998d3611-6d9d-407f-8abd-8f7c9135b279 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:50.896839 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-18ca50c3-35d5-450a-9857-9956396272de req-998d3611-6d9d-407f-8abd-8f7c9135b279 service nova] Creating event network-changed:b1677501-043d-4414-b8e5-720801f27b48 for instance 5a945790-cfd2-40ca-9846-df71a8f5527f on hv-cinder-79987 Jul 20 23:13:50.902720 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-18ca50c3-35d5-450a-9857-9956396272de req-998d3611-6d9d-407f-8abd-8f7c9135b279 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031824 Jul 20 23:13:50.903369 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 640/1271] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:13:50.914766 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-dc432248-8176-4b44-843f-fe53322ba7e3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Going to try to terminate instance {{(pid=124912) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 23:13:51.203692 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-dc432248-8176-4b44-843f-fe53322ba7e3 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 204 len: 0 microversion: 2.1 time: 0.334898 Jul 20 23:13:51.207854 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 632/1272] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 23:13:50 2022] DELETE /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 23:13:51.214245 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-c4e69b7b-26da-4f96-bd3c-d95223e8aec7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:51.214949 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-c4e69b7b-26da-4f96-bd3c-d95223e8aec7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:51.224058 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c4e69b7b-26da-4f96-bd3c-d95223e8aec7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:51.228121 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c4e69b7b-26da-4f96-bd3c-d95223e8aec7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:51.228121 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c4e69b7b-26da-4f96-bd3c-d95223e8aec7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:51.228121 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-c4e69b7b-26da-4f96-bd3c-d95223e8aec7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:51.359145 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.policy [None req-c4e69b7b-26da-4f96-bd3c-d95223e8aec7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124913) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:13:51.367335 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-c4e69b7b-26da-4f96-bd3c-d95223e8aec7 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1578 microversion: 2.1 time: 0.157981 Jul 20 23:13:51.367900 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 641/1273] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:51 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:13:52.385777 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-fe9063d3-071a-416f-a0ad-f8dbc109662d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:52.386597 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-fe9063d3-071a-416f-a0ad-f8dbc109662d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:52.393226 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fe9063d3-071a-416f-a0ad-f8dbc109662d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:52.393673 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fe9063d3-071a-416f-a0ad-f8dbc109662d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:52.395057 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fe9063d3-071a-416f-a0ad-f8dbc109662d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:52.395513 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-fe9063d3-071a-416f-a0ad-f8dbc109662d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:52.534758 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-fe9063d3-071a-416f-a0ad-f8dbc109662d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:13:52.542351 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-fe9063d3-071a-416f-a0ad-f8dbc109662d tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1578 microversion: 2.1 time: 0.160971 Jul 20 23:13:52.542906 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 633/1274] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:52 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:13:53.445074 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [req-e2b2c7f6-4c5d-4655-824c-36c3401022ed req-c99f8366-c89f-4579-8172-58d2c147be02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a945790-cfd2-40ca-9846-df71a8f5527f", "name": "network-vif-deleted", "tag": "b1677501-043d-4414-b8e5-720801f27b48"}]} {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 23:13:53.453583 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-e2b2c7f6-4c5d-4655-824c-36c3401022ed req-c99f8366-c89f-4579-8172-58d2c147be02 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:53.454014 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [req-e2b2c7f6-4c5d-4655-824c-36c3401022ed req-c99f8366-c89f-4579-8172-58d2c147be02 service nova] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:53.465222 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.compute.server_external_events [req-e2b2c7f6-4c5d-4655-824c-36c3401022ed req-c99f8366-c89f-4579-8172-58d2c147be02 service nova] Creating event network-vif-deleted:b1677501-043d-4414-b8e5-720801f27b48 for instance 5a945790-cfd2-40ca-9846-df71a8f5527f on hv-cinder-79987 Jul 20 23:13:53.469948 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [req-e2b2c7f6-4c5d-4655-824c-36c3401022ed req-c99f8366-c89f-4579-8172-58d2c147be02 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028639 Jul 20 23:13:53.470528 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 642/1275] 10.222.0.81 () {64 vars in 1317 bytes} [Wed Jul 20 23:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 23:13:53.559455 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-4eb87d9f-d51d-4091-829a-881b8e07b29e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:53.560059 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-4eb87d9f-d51d-4091-829a-881b8e07b29e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:53.567335 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4eb87d9f-d51d-4091-829a-881b8e07b29e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:53.567840 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4eb87d9f-d51d-4091-829a-881b8e07b29e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:53.568572 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4eb87d9f-d51d-4091-829a-881b8e07b29e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:53.568980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-4eb87d9f-d51d-4091-829a-881b8e07b29e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:53.631725 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.policy [None req-4eb87d9f-d51d-4091-829a-881b8e07b29e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13390807045f4acdbbe4ea77af4dbb52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9044845bc9d34e1e8794a43dda688527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124912) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 23:13:53.639366 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-4eb87d9f-d51d-4091-829a-881b8e07b29e tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 200 len: 1224 microversion: 2.1 time: 0.083741 Jul 20 23:13:53.639977 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 634/1276] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:53 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 23:13:54.657586 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:54.658322 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: 5a945790-cfd2-40ca-9846-df71a8f5527f] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:54.664720 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:54.665170 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:54.665933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:54.666366 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:54.681440 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] HTTP exception thrown: Instance 5a945790-cfd2-40ca-9846-df71a8f5527f could not be found. Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Request method failure captured: Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f HTTP/1.1 Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IpTjISVBLuMwzxzq_uhOBtFwC0daWVO11LfDtIkBLweKxqWyh3Kt6IQFrjNnhCWlaN7JFYahQs1BdPn6uDgK3SbUMAq7Au9Usja-UWa0DxOAEHWB6GaS75iKYLYPNKEtP9jv2VrMGYkmy2xvFMr80ieizJgz_eGevMFc0FZtAjKcvU Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 23:13:54.683071 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9044845bc9d34e1e8794a43dda688527", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 13390807045f4acdbbe4ea77af4dbb52 Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance 5a945790-cfd2-40ca-9846-df71a8f5527f could not be found. Jul 20 23:13:54.684896 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': '5a945790-cfd2-40ca-9846-df71a8f5527f'} Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a945790-cfd2-40ca-9846-df71a8f5527f could not be found. Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:13:54.685920 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a945790-cfd2-40ca-9846-df71a8f5527f could not be found. Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a945790-cfd2-40ca-9846-df71a8f5527f could not be found. Jul 20 23:13:54.687711 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:54.689263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Returning 404 to user: Instance 5a945790-cfd2-40ca-9846-df71a8f5527f could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:13:54.689263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-ea24b34d-04ee-44cf-bc83-a7f6433e2895 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f" status: 404 len: 111 microversion: 2.1 time: 0.031471 Jul 20 23:13:54.689263 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 643/1277] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:54 2022] GET /compute/v2.1/servers/5a945790-cfd2-40ca-9846-df71a8f5527f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 23:13:55.206873 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:55.207406 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.compute.api [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124912) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:55.213794 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:55.214235 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:55.214980 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:55.215433 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG oslo_concurrency.lockutils [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124912) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:55.229090 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.wsgi [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] HTTP exception thrown: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Request method failure captured: Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: request: DELETE /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 HTTP/1.1 Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept: application/json Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Accept-Encoding: identity Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Connection: close Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Length: 0 Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Content-Type: application/json Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Host: 10.222.0.81 Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Openstack-System-Scope: None Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: User-Agent: python-urllib3/1.26.9 Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Auth-Token: gAAAAABi2IpTjISVBLuMwzxzq_uhOBtFwC0daWVO11LfDtIkBLweKxqWyh3Kt6IQFrjNnhCWlaN7JFYahQs1BdPn6uDgK3SbUMAq7Au9Usja-UWa0DxOAEHWB6GaS75iKYLYPNKEtP9jv2VrMGYkmy2xvFMr80ieizJgz_eGevMFc0FZtAjKcvU Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Id: None Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Domain-Name: None Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Identity-Status: Confirmed Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Is-Admin-Project: True Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Id: default Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Domain-Name: Default Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Project-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Role: reader,member Jul 20 23:13:55.230791 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Roles: reader,member Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9044845bc9d34e1e8794a43dda688527", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Id: default Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Domain-Name: Default Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Id: 13390807045f4acdbbe4ea77af4dbb52 Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: X-User-Name: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: method: > Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: exception: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.232583 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: action_args: {'id': 'ac2a654b-6f72-4edd-818a-4ed2fd111741'} Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:13:55.233556 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.235282 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.238011 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Returning 404 to user: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. {{(pid=124912) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:13:55.238011 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-c4392082-3d5f-404f-8b4f-c6ff367e009b tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 404 len: 111 microversion: 2.1 time: 0.029721 Jul 20 23:13:55.238011 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 635/1278] 10.222.0.81 () {58 vars in 1238 bytes} [Wed Jul 20 23:13:55 2022] DELETE /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 23:13:55.240778 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '>' {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:55.241375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.compute.api [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] [instance: ac2a654b-6f72-4edd-818a-4ed2fd111741] Fetching instance by UUID {{(pid=124913) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 23:13:55.247178 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:55.247615 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:55.248375 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 23:13:55.248803 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG oslo_concurrency.lockutils [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Lock "ac8e65b0-7529-4d82-95f8-8407fdc93621" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 23:13:55.262383 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.wsgi [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] HTTP exception thrown: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Request method failure captured: Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: request: GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 HTTP/1.1 Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept: application/json Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Accept-Encoding: identity Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Connection: close Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Length: 0 Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Content-Type: application/json Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Host: 10.222.0.81 Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Openstack-System-Scope: None Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: User-Agent: python-urllib3/1.26.9 Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Auth-Token: gAAAAABi2IpTjISVBLuMwzxzq_uhOBtFwC0daWVO11LfDtIkBLweKxqWyh3Kt6IQFrjNnhCWlaN7JFYahQs1BdPn6uDgK3SbUMAq7Au9Usja-UWa0DxOAEHWB6GaS75iKYLYPNKEtP9jv2VrMGYkmy2xvFMr80ieizJgz_eGevMFc0FZtAjKcvU Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Id: None Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Domain-Name: None Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Identity-Status: Confirmed Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Is-Admin-Project: True Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Id: default Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Domain-Name: Default Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Project-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Role: reader,member Jul 20 23:13:55.263933 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Roles: reader,member Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_9044845bc9d34e1e8794a43dda688527", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/9044845bc9d34e1e8794a43dda688527"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}] Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Id: 9044845bc9d34e1e8794a43dda688527 Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-Tenant-Name: tempest-TestVolumeBootPattern-1181010927 Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Id: default Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Domain-Name: Default Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Id: 13390807045f4acdbbe4ea77af4dbb52 Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: X-User-Name: tempest-TestVolumeBootPattern-1181010927-project Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: method: > Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: exception: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.265686 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: action_args: {'id': 'ac2a654b-6f72-4edd-818a-4ed2fd111741'} Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: {{(pid=124913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 23:13:55.266692 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. Jul 20 23:13:55.268371 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: ERROR nova.api.openstack.wsgi Jul 20 23:13:55.270511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: DEBUG nova.api.openstack.wsgi [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Returning 404 to user: Instance ac2a654b-6f72-4edd-818a-4ed2fd111741 could not be found. {{(pid=124913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 23:13:55.270511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO nova.api.openstack.requestlog [None req-4290e5a7-2b11-43a1-8ee2-f4a9d5b424c9 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741" status: 404 len: 111 microversion: 2.1 time: 0.028538 Jul 20 23:13:55.270511 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: [pid: 124913|app: 0|req: 644/1279] 10.222.0.81 () {58 vars in 1235 bytes} [Wed Jul 20 23:13:55 2022] GET /compute/v2.1/servers/ac2a654b-6f72-4edd-818a-4ed2fd111741 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 23:13:56.768042 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: DEBUG nova.api.openstack.wsgi [None req-35be4644-5a21-424b-bc68-b4bf8dd0b1d5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] Calling method '.version_select at 0x7fe243f80160>' {{(pid=124912) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 23:13:56.848914 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO nova.api.openstack.requestlog [None req-35be4644-5a21-424b-bc68-b4bf8dd0b1d5 tempest-TestVolumeBootPattern-1181010927 tempest-TestVolumeBootPattern-1181010927-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-648746233" status: 202 len: 0 microversion: 2.1 time: 0.084702 Jul 20 23:13:56.849660 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: [pid: 124912|app: 0|req: 636/1280] 10.222.0.81 () {58 vars in 1259 bytes} [Wed Jul 20 23:13:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-648746233 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 23:14:05.570546 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:14:05.571121 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:14:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:15:34.834248 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:15:34.834845 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:15:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:15:41.276414 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:15:41.277038 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:15:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:16:06.456529 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:16:06.457202 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:17:25.580618 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:17:25.581246 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:18:54.842291 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:18:54.842855 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:18:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:19:01.284076 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:19:01.284698 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:19:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:19:01.428264 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:19:01.428843 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:19:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:19:26.465762 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:19:26.466308 dv-cinder-799871-38-iscsi devstack@n-api.service[124913]: Wed Jul 20 23:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 23:19:27.698889 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 23:19:27.699540 dv-cinder-799871-38-iscsi devstack@n-api.service[124912]: Wed Jul 20 23:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!